Nov 01 12:13:54 devstack cinder-volume[75782]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 12:13:54 devstack cinder-volume[75782]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 12:13:54 devstack cinder-volume[75782]: we strongly recommend against using it for new projects. Nov 01 12:13:54 devstack cinder-volume[75782]: If you are already using Eventlet, we recommend migrating to a different Nov 01 12:13:54 devstack cinder-volume[75782]: framework. For more detail see Nov 01 12:13:54 devstack cinder-volume[75782]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 12:13:54 devstack cinder-volume[75782]: import eventlet # noqa Nov 01 12:13:57 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:13:57 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:13:57 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:13:58 devstack cinder-volume[75782]: INFO dbcounter [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Registered counter for database cinder Nov 01 12:13:58 devstack cinder-volume[75782]: DEBUG oslo_db.sqlalchemy.engines [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75782) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:13:58 devstack cinder-volume[75782]: DEBUG dbcounter [-] [75782] Writer thread running {{(pid=75782) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:13:58 devstack cinder-volume[75782]: INFO cinder.rpc [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 12:13:58 devstack cinder-volume[75782]: INFO cinder.rpc [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 12:13:58 devstack cinder-volume[75782]: DEBUG oslo_db.sqlalchemy.engines [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75782) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:13:58 devstack cinder-volume[75782]: INFO cinder.volume.manager [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Determined volume DB was empty at startup. Nov 01 12:13:58 devstack cinder-volume[75782]: DEBUG cinder.volume.manager [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75782) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 12:13:58 devstack cinder-volume[75782]: INFO cinder.volume.manager [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 01 12:13:58 devstack cinder-volume[75782]: WARNING stevedore.named [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 12:13:58 devstack cinder-volume[75782]: WARNING castellan.key_manager [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:13:58 devstack cinder-volume[75782]: WARNING cinder.keymgr.conf_key_mgr [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:13:58 devstack cinder-volume[75782]: DEBUG cinder.volume.drivers.lvm [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75782) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 01 12:13:58 devstack cinder-volume[75782]: DEBUG oslo_concurrency.processutils [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75782) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_concurrency.processutils [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] CMD "cinder-rtstool verify" returned: 0 in 0.427s {{(pid=75782) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_db.sqlalchemy.engines [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75782) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:13:59 devstack cinder-volume[75782]: INFO cinder.rpc [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 01 12:13:59 devstack cinder-volume[75782]: INFO cinder.rpc [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 01 12:13:59 devstack cinder-volume[75782]: WARNING stevedore.named [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 12:13:59 devstack cinder-volume[75782]: WARNING castellan.key_manager [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:13:59 devstack cinder-volume[75782]: INFO cinder.volume.manager [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_db.sqlalchemy.engines [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75782) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:13:59 devstack cinder-volume[75782]: INFO oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Starting 1 workers Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Started child 75936 {{(pid=75782) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Full set of CONF: {{(pid=75782) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] ******************************************************************************** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Configuration options gathered from: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] ================================================================================ {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] allow_availability_zone_fallback = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] allow_compression_on_image_upload = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] allowed_direct_url_schemes = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] api_rate_limit = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] auth_strategy = keystone {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] az_cache_duration = 3600 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_availability_zone = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_host = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_stats_polling_interval = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backup_api_class = cinder.backup.api.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backup_name_template = backup-%s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backup_use_same_host = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backup_use_temp_snapshot = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] chap_password = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] chap_username = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cinder_internal_tenant_project_id = 44d9c284f7764116861a40eefcf6c767 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cinder_internal_tenant_user_id = 50f326ae31f446c9afaacb7c30403aeb {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cloned_volume_same_az = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cluster = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] compression_format = gzip {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] compute_api_class = cinder.compute.nova.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] config_dir = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] config_source = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] control_exchange = openstack {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] debug = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] default_availability_zone = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75936]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] default_group_type = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] default_volume_type = lvmdriver-1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] disk_geometry = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] driver_client_cert = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] driver_client_cert_key = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] driver_data_namespace = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] driver_ssl_cert_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] driver_ssl_cert_verify = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] driver_use_ssl = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] enable_force_upload = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] enable_new_services = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] enable_unsupported_driver = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] enforce_multipath_for_image_xfer = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] filter_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance_api_insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance_api_ssl_compression = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance_ca_certificates_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance_catalog_info = image:glance:publicURL {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance_certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance_keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance_num_retries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance_request_timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] goodness_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] graceful_shutdown_timeout = 5 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] group_api_class = cinder.group.api.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] host = devstack {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_compress_on_upload = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_conversion_address_space_limit = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_conversion_cpu_limit = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_conversion_disable = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_introspection_address_space_limit = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_introspection_cpu_limit = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_upload_use_cinder_backend = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_upload_use_internal_tenant = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_volume_cache_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_volume_cache_max_count = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] image_volume_cache_max_size_gb = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] init_host_max_objects_retrieval = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75936]: INFO cinder.volume.manager [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] instance_format = [instance: %(uuid)s] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] iscsi_target_flags = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] iscsi_write_cache = on {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] iser_helper = tgtadm {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] iser_ip_address = 192.168.122.240 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] iser_port = 3260 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] log_color = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] log_config_append = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] log_dir = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] log_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] log_options = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] log_rotate_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] log_rotate_interval_type = days {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] log_rotation_type = none {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] max_age = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] max_logfile_count = 30 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] max_logfile_size_mb = 200 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] max_over_subscription_ratio = 20.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] message_reap_interval = 86400 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:13:59 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] message_ttl = 2592000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] migration_create_volume_timeout_secs = 300 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] monkey_patch = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] monkey_patch_modules = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] my_ip = 192.168.122.240 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] no_snapshot_gb_quota = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] num_iser_scan_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] num_shell_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] num_volume_device_scan_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] nvmeof_conn_info_version = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] nvmet_ns_id = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] nvmet_port_id = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] osapi_max_limit = 1000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] osapi_volume_ext_list = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] osapi_volume_listen_port = 8776 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] osapi_volume_use_ssl = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] osapi_volume_workers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] per_volume_size_limit = -1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] periodic_fuzzy_delay = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] periodic_interval = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] public_endpoint = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] publish_errors = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] quota_backup_gigabytes = 1000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] quota_backups = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] quota_gigabytes = 1000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] quota_groups = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] quota_snapshots = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] quota_volumes = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] rate_limit_burst = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] rate_limit_except_level = CRITICAL {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] rate_limit_interval = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:13:59 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] reinit_driver_count = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] replication_device = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] report_discard_supported = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] report_interval = 120 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] reservation_clean_interval = 86400 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] reservation_expire = 86400 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] reserved_image_namespaces = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] reserved_percentage = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] rpc_response_timeout = 120 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] run_external_periodic_tasks = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] scst_target_driver = iscsi {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack sudo[75941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 01 12:13:59 devstack sudo[75941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] scst_target_iqn_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_down_time = 720 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] shell_completion = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] snapshot_name_template = snapshot-%s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] snapshot_same_host = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] split_loggers = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] state_path = /opt/stack/data/cinder {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] storage_availability_zone = nova {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] storage_protocol = iSCSI {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] syslog_log_facility = LOG_USER {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] target_helper = lioadm {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] target_ip_address = 192.168.122.240 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] target_port = 3260 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] target_protocol = iscsi {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] target_secondary_ip_addresses = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] trace_flags = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] transport_url = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] until_refresh = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] use_chap_auth = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] use_default_quota_class = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] use_journal = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] use_json = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] use_multipath_for_image_xfer = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] use_stderr = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] use_syslog = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] verify_glance_signatures = enabled {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_api_class = cinder.volume.api.API {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_backend_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_clear = zero {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_clear_ionice = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_clear_size = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_copy_bps_limit = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_dd_blocksize = 1M {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_name_template = volume-%s {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_service_inithost_offload = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volume_usage_audit_period = month {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] zoning_mode = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_concurrency.disable_process_locking = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.auth_section = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.auth_type = password {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.auth_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.cache = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.include_service_catalog = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.interface = public {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_password = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcache_username = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.region_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.service_type = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.backend = dogpile.cache.null {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.backend_argument = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.backend_expiration_time = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.config_prefix = cache.oslo {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.debug_cache_backend = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.enable_retry_client = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.enable_socket_keepalive = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.expiration_time = 600 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.hashclient_retry_attempts = 2 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.memcache_dead_retry = 300 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.memcache_pool_maxsize = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.memcache_sasl_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.password = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.proxies = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.redis_db = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.redis_server = localhost:6379 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.retry_attempts = 2 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.retry_delay = 0.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.socket_keepalive_count = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.socket_keepalive_idle = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.socket_keepalive_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.socket_timeout = 1.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.tls_allowed_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.tls_cafile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.tls_certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.tls_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.tls_keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cache.username = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] coordination.backend_url = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.asyncio_connection = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.asyncio_slave_connection = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.backend = sqlalchemy {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.connection = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.connection_debug = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.connection_parameters = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.connection_recycle_time = 3600 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.connection_trace = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.db_inc_retry_interval = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.db_max_retries = 20 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.db_max_retry_interval = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.db_retry_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.max_overflow = 50 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.max_pool_size = 5 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.max_retries = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.mysql_wsrep_sync_wait = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.pool_timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.retry_interval = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.slave_connection = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.sqlite_synchronous = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.synchronous_reader = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] database.use_db_reconnect = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_tracing.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.connection_string = messaging:// {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.es_doc_type = notification {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.es_scroll_size = 10000 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.es_scroll_time = 2m {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.filter_error_trace = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.hmac_keys = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.sentinel_service_name = mymaster {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.socket_timeout = 0.1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.trace_requests = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler.trace_sqlalchemy = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler_jaeger.process_tags = {} {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler_jaeger.service_name_prefix = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] profiler_otlp.service_name_prefix = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_policy.enforce_new_defaults = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_policy.policy_default_rule = default {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_policy.policy_file = policy.yaml {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] privsep_osbrick.group = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] privsep_osbrick.helper_command = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] privsep_osbrick.user = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cinder_sys_admin.group = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cinder_sys_admin.helper_command = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] cinder_sys_admin.user = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.auth_section = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.auth_type = password {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.cafile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.collect_timing = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.send_service_user_token = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.split_loggers = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.tls_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] service_user.tls_min_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.auth_section = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.auth_type = password {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.collect_timing = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.region_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.split_loggers = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.tls_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] glance.tls_min_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.backend_availability_zone = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.chap_password = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.chap_username = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.disk_geometry = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.driver_client_cert = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.driver_client_cert_key = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.driver_data_namespace = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.driver_use_ssl = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.extra_capabilities = {} {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.filter_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.goodness_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.iscsi_target_flags = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.iscsi_write_cache = on {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.iser_helper = tgtadm {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.iser_port = 3260 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.lvm_share_target = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.lvm_type = auto {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.num_shell_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.replication_device = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.report_discard_supported = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.reserved_percentage = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.target_helper = tgtadm {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.target_port = 3260 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.target_protocol = iscsi {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.trace_flags = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.unique_fqdn_network = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.use_chap_auth = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.volume_backend_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.volume_clear = zero {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.volume_clear_ionice = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.volume_clear_size = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_reports.file_event_handler = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_reports.log_dir = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.backend_host = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.chap_password = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.chap_username = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.disk_geometry = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:13:59 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.driver_client_cert = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.extra_capabilities = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.filter_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.goodness_function = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.iser_helper = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.iser_ip_address = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.iser_port = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.lvm_share_target = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.lvm_type = auto {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.num_shell_tries = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.replication_device = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.report_discard_supported = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.reserved_percentage = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.scst_target_driver = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.storage_protocol = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.target_helper = lioadm {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.target_ip_address = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.target_port = 3260 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.trace_flags = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.use_chap_auth = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.volume_clear = zero {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.volume_clear_size = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] lvmdriver-1.volumes_dir = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.ssl = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_notifications.driver = [] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_notifications.retry = -1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] key_manager.fixed_key = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.barbican_api_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.barbican_endpoint = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.barbican_endpoint_type = public {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.barbican_region_name = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.cafile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.collect_timing = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.number_of_retries = 60 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.retry_delay = 1 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.send_service_user_token = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.split_loggers = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.tls_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.tls_min_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.verify_ssl = True {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican.verify_ssl_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.auth_section = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.auth_type = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.cafile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.certfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.collect_timing = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.insecure = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.keyfile = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.split_loggers = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.timeout = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.tls_ciphers = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] barbican_service_user.tls_min_version = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.approle_role_id = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.approle_secret_id = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.auth_method = approle {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.auth_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.kv_mountpoint = secret {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.kv_path = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.kv_version = 2 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.namespace = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.root_token_id = **** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.ssl_ca_crt_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.timeout = 60.0 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.token_file = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.token_role = None {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.use_ssl = False {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:00 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] ******************************************************************************** {{(pid=75782) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 12:14:00 devstack sudo[75941]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:00 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.386s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:00 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:00 devstack sudo[75996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:00 devstack sudo[75996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:00 devstack sudo[75996]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:00 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.276s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:00 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:14:00 devstack cinder-volume[75936]: INFO cinder.brick.local_dev.lvm [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 01 12:14:00 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:00 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:00 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:00 devstack sudo[76109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:00 devstack sudo[76109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:00 devstack sudo[76109]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:00 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:00 devstack cinder-volume[75936]: DEBUG cinder.brick.local_dev.lvm [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75936) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 01 12:14:00 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:00 devstack sudo[76205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:00 devstack sudo[76205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:01 devstack sudo[76205]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:01 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.512s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:01 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:01 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:01 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:01 devstack sudo[76398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:01 devstack sudo[76398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:01 devstack sudo[76398]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:01 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:01 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:01 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:01 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:01 devstack sudo[76475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 01 12:14:01 devstack sudo[76475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:01 devstack sudo[76475]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:01 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.336s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:01 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:01 devstack sudo[76554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:01 devstack sudo[76554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:02 devstack sudo[76554]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:02 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:02 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:02 devstack sudo[76611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:02 devstack sudo[76611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:02 devstack sudo[76611]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:02 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.315s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:02 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:02 devstack sudo[76641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:02 devstack sudo[76641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:02 devstack sudo[76641]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:02 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:02 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:02 devstack sudo[76650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:02 devstack sudo[76650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:03 devstack sudo[76650]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:03 devstack sudo[76735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:03 devstack sudo[76735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:03 devstack sudo[76735]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:03 devstack cinder-volume[75936]: INFO cinder.volume.drivers.lvm [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:03 devstack sudo[76739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:03 devstack sudo[76739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:03 devstack sudo[76739]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG cinder.volume.drivers.lvm [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Updating volume stats {{(pid=75936) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:14:03 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:03 devstack sudo[76742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:03 devstack sudo[76742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:04 devstack sudo[76742]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:04 devstack sudo[76745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:04 devstack sudo[76745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:04 devstack sudo[76745]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:04 devstack sudo[76754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:04 devstack sudo[76754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:04 devstack sudo[76754]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:04 devstack sudo[76757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:04 devstack sudo[76757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:04 devstack sudo[76757]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:04 devstack cinder-volume[75936]: INFO cinder.volume.driver [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Driver hasn't implemented _init_vendor_properties() Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG cinder.volume.driver [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75936) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG oslo_db.sqlalchemy.engines [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75936) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG dbcounter [-] [75936] Writer thread running {{(pid=75936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG cinder.db.api [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Building query based on filter {{(pid=75936) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG cinder.image.image_utils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75936) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 12:14:04 devstack cinder-volume[75936]: INFO cinder.keymgr.migration [None req-bbbbaefb-cf0a-4f55-b63b-63357ef83e8a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG cinder.volume.drivers.lvm [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Updating volume stats {{(pid=75936) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:14:04 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:04 devstack sudo[76760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:04 devstack sudo[76760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:05 devstack sudo[76760]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:05 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:05 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:05 devstack sudo[76765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:05 devstack sudo[76765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:05 devstack sudo[76765]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:05 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:05 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:05 devstack sudo[76768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:05 devstack sudo[76768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:05 devstack sudo[76768]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:05 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:05 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:05 devstack sudo[76772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:05 devstack sudo[76772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:05 devstack sudo[76772]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:05 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:05 devstack cinder-volume[75936]: DEBUG cinder.manager [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Notifying Schedulers of capabilities ... {{(pid=75936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:14:05 devstack cinder-volume[75936]: INFO cinder.volume.manager [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Driver initialization completed successfully. Nov 01 12:14:05 devstack cinder-volume[75936]: INFO cinder.manager [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Initiating service 2 cleanup Nov 01 12:14:05 devstack cinder-volume[75936]: INFO cinder.manager [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Service 2 cleanup completed. Nov 01 12:14:05 devstack cinder-volume[75936]: DEBUG cinder.service [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Creating RPC server for service cinder-volume {{(pid=75936) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 12:14:05 devstack cinder-volume[75936]: DEBUG cinder.service [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75936) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 12:14:06 devstack cinder-volume[75936]: INFO cinder.volume.manager [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 01 12:14:06 devstack cinder-volume[75936]: DEBUG cinder.volume.drivers.lvm [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Updating volume stats {{(pid=75936) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:14:06 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:06 devstack sudo[76775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:06 devstack sudo[76775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:06 devstack sudo[76775]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:06 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:06 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:06 devstack sudo[76778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:06 devstack sudo[76778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:06 devstack sudo[76778]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:06 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:06 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:06 devstack sudo[76783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:06 devstack sudo[76783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:06 devstack sudo[76783]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:06 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:06 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:06 devstack sudo[76786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:06 devstack sudo[76786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:07 devstack sudo[76786]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:07 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:07 devstack cinder-volume[75936]: INFO cinder.volume.manager [None req-b59e4306-b8d2-4904-94a8-06d3dc56c629 None None] Driver post RPC initialization completed successfully. Nov 01 12:14:09 devstack cinder-volume[75782]: DEBUG dbcounter [-] [75782] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75782) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:14:17 devstack cinder-volume[75936]: DEBUG dbcounter [-] [75936] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:14:17 devstack cinder-volume[75936]: DEBUG dbcounter [-] [75936] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:14:46 devstack cinder-volume[75936]: DEBUG oslo_service.periodic_task [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running periodic task VolumeManager._thread_info {{(pid=75936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:14:46 devstack cinder-volume[75936]: DEBUG cinder.volume.manager [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] thread count: 6 {{(pid=75936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:14:46 devstack cinder-volume[75936]: DEBUG cinder.volume.manager [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] thread info: [<_MainThread(MainThread, started 136081240322176)>, , , , , ] {{(pid=75936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:15:46 devstack cinder-volume[75936]: DEBUG oslo_service.periodic_task [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:15:46 devstack cinder-volume[75936]: DEBUG cinder.volume.drivers.lvm [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Updating volume stats {{(pid=75936) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:15:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:15:46 devstack sudo[81885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:15:46 devstack sudo[81885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:15:46 devstack sudo[81885]: pam_unix(sudo:session): session closed for user root Nov 01 12:15:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:15:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:15:46 devstack sudo[81888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:15:46 devstack sudo[81888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:15:46 devstack sudo[81888]: pam_unix(sudo:session): session closed for user root Nov 01 12:15:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:15:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:15:46 devstack sudo[81891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:15:46 devstack sudo[81891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:15:46 devstack sudo[81891]: pam_unix(sudo:session): session closed for user root Nov 01 12:15:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:15:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:15:47 devstack sudo[81894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:15:47 devstack sudo[81894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:15:47 devstack sudo[81894]: pam_unix(sudo:session): session closed for user root Nov 01 12:15:47 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:15:47 devstack cinder-volume[75936]: DEBUG cinder.manager [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Notifying Schedulers of capabilities ... {{(pid=75936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:15:47 devstack cinder-volume[75936]: DEBUG oslo_service.periodic_task [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running periodic task VolumeManager._thread_info {{(pid=75936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:15:47 devstack cinder-volume[75936]: DEBUG cinder.volume.manager [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] thread count: 6 {{(pid=75936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:15:47 devstack cinder-volume[75936]: DEBUG cinder.volume.manager [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] thread info: [<_MainThread(MainThread, started 136081240322176)>, , , , , ] {{(pid=75936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:16:17 devstack cinder-volume[75936]: DEBUG dbcounter [-] [75936] Writing DB stats cinder:SELECT=1 {{(pid=75936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:16:17 devstack cinder-volume[75936]: DEBUG dbcounter [-] [75936] Writing DB stats cinder:UPDATE=1 {{(pid=75936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:16:46 devstack cinder-volume[75936]: DEBUG oslo_service.periodic_task [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:16:46 devstack cinder-volume[75936]: DEBUG cinder.volume.drivers.lvm [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Updating volume stats {{(pid=75936) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:16:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:16:46 devstack sudo[83659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:16:46 devstack sudo[83659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:16:46 devstack sudo[83659]: pam_unix(sudo:session): session closed for user root Nov 01 12:16:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:16:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:16:46 devstack sudo[83693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:16:46 devstack sudo[83693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:16:46 devstack sudo[83693]: pam_unix(sudo:session): session closed for user root Nov 01 12:16:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:16:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:16:46 devstack sudo[83696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:16:46 devstack sudo[83696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:16:47 devstack sudo[83696]: pam_unix(sudo:session): session closed for user root Nov 01 12:16:47 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:16:47 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:16:47 devstack sudo[83710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:16:47 devstack sudo[83710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:16:47 devstack sudo[83710]: pam_unix(sudo:session): session closed for user root Nov 01 12:16:47 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:16:47 devstack cinder-volume[75936]: DEBUG cinder.manager [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Notifying Schedulers of capabilities ... {{(pid=75936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:16:47 devstack cinder-volume[75936]: DEBUG oslo_service.periodic_task [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running periodic task VolumeManager._thread_info {{(pid=75936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:16:47 devstack cinder-volume[75936]: DEBUG cinder.volume.manager [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] thread count: 6 {{(pid=75936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:16:47 devstack cinder-volume[75936]: DEBUG cinder.volume.manager [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] thread info: [<_MainThread(MainThread, started 136081240322176)>, , , , , ] {{(pid=75936) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:17:46 devstack cinder-volume[75936]: DEBUG oslo_service.periodic_task [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75936) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:17:46 devstack cinder-volume[75936]: DEBUG cinder.volume.drivers.lvm [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Updating volume stats {{(pid=75936) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:17:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:17:46 devstack sudo[85140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:17:46 devstack sudo[85140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:17:46 devstack sudo[85140]: pam_unix(sudo:session): session closed for user root Nov 01 12:17:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:17:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:17:46 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:17:46 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:17:46 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Nov 01 12:17:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:17:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:17:46 devstack sudo[85147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:17:46 devstack sudo[85147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:17:46 devstack sudo[85147]: pam_unix(sudo:session): session closed for user root Nov 01 12:17:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:17:46 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:17:46 devstack sudo[85150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:17:46 devstack sudo[85150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:17:47 devstack sudo[85150]: pam_unix(sudo:session): session closed for user root Nov 01 12:17:47 devstack cinder-volume[75936]: DEBUG oslo_concurrency.processutils [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75936) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:17:47 devstack cinder-volume[75936]: DEBUG cinder.manager [None req-878b67d0-6260-4b8b-8b7d-7a789846e01b None None] Notifying Schedulers of capabilities ... {{(pid=75936) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:18:17 devstack cinder-volume[75936]: DEBUG dbcounter [-] [75936] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:18:23 devstack cinder-volume[75782]: INFO oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Caught SIGTERM, stopping children Nov 01 12:18:23 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Acquiring lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:18:23 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Acquired lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:18:23 devstack cinder-volume[75782]: DEBUG oslo_concurrency.lockutils [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Releasing lock "singleton_lock" {{(pid=75782) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:18:23 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Stop services. {{(pid=75782) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 01 12:18:23 devstack cinder-volume[75782]: DEBUG oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Killing children. {{(pid=75782) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 01 12:18:23 devstack cinder-volume[75782]: INFO oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Waiting on 1 children to exit Nov 01 12:18:26 devstack cinder-volume[75936]: DEBUG oslo_concurrency.lockutils [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Acquiring lock "singleton_lock" {{(pid=75936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:18:26 devstack cinder-volume[75936]: DEBUG oslo_concurrency.lockutils [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Acquired lock "singleton_lock" {{(pid=75936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:18:26 devstack cinder-volume[75936]: DEBUG oslo_concurrency.lockutils [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Releasing lock "singleton_lock" {{(pid=75936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:18:26 devstack cinder-volume[75936]: WARNING amqp [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 12:18:26 devstack cinder-volume[75936]: WARNING amqp [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 12:18:26 devstack cinder-volume[75782]: INFO oslo_service.backend._eventlet.service [None req-7bef1b98-4fce-47f5-900f-d45e1fceba55 None None] Child 75936 exited with status 0 Nov 01 12:18:26 devstack cinder-volume[85984]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 12:18:26 devstack cinder-volume[85984]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 12:18:26 devstack cinder-volume[85984]: we strongly recommend against using it for new projects. Nov 01 12:18:26 devstack cinder-volume[85984]: If you are already using Eventlet, we recommend migrating to a different Nov 01 12:18:26 devstack cinder-volume[85984]: framework. For more detail see Nov 01 12:18:26 devstack cinder-volume[85984]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 12:18:26 devstack cinder-volume[85984]: import eventlet # noqa Nov 01 12:18:28 devstack cinder-volume[85984]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:18:28 devstack cinder-volume[85984]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:18:28 devstack cinder-volume[85984]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:18:29 devstack cinder-volume[85984]: INFO dbcounter [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Registered counter for database cinder Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_db.sqlalchemy.engines [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85984) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG dbcounter [-] [85984] Writer thread running {{(pid=85984) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:18:29 devstack cinder-volume[85984]: INFO cinder.rpc [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 12:18:29 devstack cinder-volume[85984]: INFO cinder.rpc [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_db.sqlalchemy.engines [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85984) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:29 devstack cinder-volume[85984]: INFO cinder.volume.manager [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Determined volume DB was empty at startup. Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG cinder.volume.manager [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85984) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 12:18:29 devstack cinder-volume[85984]: INFO cinder.volume.manager [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 01 12:18:29 devstack cinder-volume[85984]: WARNING stevedore.named [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 12:18:29 devstack cinder-volume[85984]: WARNING castellan.key_manager [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:18:29 devstack cinder-volume[85984]: WARNING cinder.keymgr.conf_key_mgr [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:18:29 devstack cinder-volume[85984]: INFO cinder.volume.manager [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_db.sqlalchemy.engines [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85984) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:29 devstack cinder-volume[85984]: INFO oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Starting 1 workers Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Started child 86202 {{(pid=85984) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Full set of CONF: {{(pid=85984) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] ******************************************************************************** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Configuration options gathered from: {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] ================================================================================ {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] allow_availability_zone_fallback = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:29 devstack cinder-volume[86202]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] allow_compression_on_image_upload = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] allowed_direct_url_schemes = [] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] api_rate_limit = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] auth_strategy = keystone {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_availability_zone = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_host = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_name = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_stats_polling_interval = 60 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:29 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backup_api_class = cinder.backup.api.API {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backup_name_template = backup-%s {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backup_use_same_host = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backup_use_temp_snapshot = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] chap_password = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] chap_username = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cinder_internal_tenant_project_id = 44d9c284f7764116861a40eefcf6c767 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cinder_internal_tenant_user_id = 50f326ae31f446c9afaacb7c30403aeb {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cluster = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] compression_format = gzip {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] compute_api_class = cinder.compute.nova.API {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] config_dir = [] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] config_source = [] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] control_exchange = openstack {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] debug = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] default_availability_zone = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] default_group_type = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] default_volume_type = QuobyteHD {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] disk_geometry = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] driver_client_cert = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] driver_client_cert_key = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] driver_data_namespace = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] driver_ssl_cert_path = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] driver_ssl_cert_verify = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] driver_use_ssl = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] enable_new_services = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] enable_unsupported_driver = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] enabled_backends = ['QuobyteHD'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] enforce_multipath_for_image_xfer = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] filter_function = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance_api_insecure = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance_api_ssl_compression = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance_ca_certificates_file = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance_catalog_info = image:glance:publicURL {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance_certfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance_keyfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance_num_retries = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance_request_timeout = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] goodness_function = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] graceful_shutdown_timeout = 5 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] group_api_class = cinder.group.api.API {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] host = devstack {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_compress_on_upload = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_conversion_address_space_limit = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_conversion_cpu_limit = 60 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_conversion_disable = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_introspection_address_space_limit = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_introspection_cpu_limit = 60 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_upload_use_cinder_backend = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_upload_use_internal_tenant = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_volume_cache_enabled = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_volume_cache_max_count = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] init_host_max_objects_retrieval = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] instance_format = [instance: %(uuid)s] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] iscsi_target_flags = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] iscsi_write_cache = on {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] iser_helper = tgtadm {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] iser_ip_address = 192.168.122.240 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] iser_port = 3260 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] log_color = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] log_config_append = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] log_dir = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] log_file = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] log_options = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] log_rotate_interval = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] log_rotate_interval_type = days {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] log_rotation_type = none {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] max_age = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] max_logfile_count = 30 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] max_logfile_size_mb = 200 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] max_over_subscription_ratio = 20.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] message_reap_interval = 86400 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] message_ttl = 2592000 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] monkey_patch = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] monkey_patch_modules = [] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] my_ip = 192.168.122.240 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] no_snapshot_gb_quota = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] num_iser_scan_tries = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] num_shell_tries = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] num_volume_device_scan_tries = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] nvmeof_conn_info_version = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] nvmet_ns_id = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] nvmet_port_id = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] osapi_max_limit = 1000 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] osapi_volume_ext_list = [] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[86202]: INFO cinder.volume.manager [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG cinder.volume.drivers.remotefs [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86202) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] osapi_volume_listen_port = 8776 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] osapi_volume_use_ssl = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] osapi_volume_workers = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] per_volume_size_limit = -1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] periodic_fuzzy_delay = 60 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] periodic_interval = 60 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] public_endpoint = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] publish_errors = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] quota_backup_gigabytes = 1000 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] quota_backups = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] quota_gigabytes = 1000 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] quota_groups = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] quota_snapshots = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] quota_volumes = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] rate_limit_burst = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] rate_limit_except_level = CRITICAL {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] rate_limit_interval = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] reinit_driver_count = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] replication_device = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] report_discard_supported = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] report_interval = 120 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] reservation_clean_interval = 86400 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] reservation_expire = 86400 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] reserved_image_namespaces = [] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] reserved_percentage = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] rpc_response_timeout = 120 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] run_external_periodic_tasks = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] scst_target_driver = iscsi {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] scst_target_iqn_name = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_down_time = 720 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] shell_completion = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] snapshot_name_template = snapshot-%s {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] split_loggers = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] state_path = /opt/stack/data/cinder {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] storage_availability_zone = nova {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] storage_protocol = iSCSI {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] syslog_log_facility = LOG_USER {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] target_helper = lioadm {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] target_ip_address = 192.168.122.240 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] target_port = 3260 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] target_protocol = iscsi {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] target_secondary_ip_addresses = [] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] trace_flags = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] transport_url = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] until_refresh = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] use_chap_auth = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] use_default_quota_class = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] use_journal = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] use_json = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] use_multipath_for_image_xfer = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] use_stderr = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] use_syslog = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] verify_glance_signatures = enabled {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_api_class = cinder.volume.api.API {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_backend_name = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_clear = zero {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_clear_ionice = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_clear_size = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_copy_bps_limit = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_dd_blocksize = 1M {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_name_template = volume-%s {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_service_inithost_offload = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volume_usage_audit_period = month {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] zoning_mode = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.auth_section = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.auth_type = password {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.auth_version = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.cache = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.certfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.insecure = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.interface = public {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.keyfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_password = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86202) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[86202]: WARNING cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[86202]: WARNING cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Running cmd (subprocess): mount.quobyte {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcache_username = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.region_name = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.service_type = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.backend = dogpile.cache.null {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.backend_argument = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.backend_expiration_time = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.config_prefix = cache.oslo {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.debug_cache_backend = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.enable_retry_client = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.enable_socket_keepalive = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.enabled = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.expiration_time = 600 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.memcache_dead_retry = 300 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.memcache_pool_maxsize = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.memcache_sasl_enabled = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.password = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.proxies = [] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.redis_db = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.redis_server = localhost:6379 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.retry_attempts = 2 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.retry_delay = 0.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.socket_keepalive_count = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.socket_keepalive_idle = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.socket_keepalive_interval = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.socket_timeout = 1.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.tls_allowed_ciphers = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.tls_cafile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.tls_certfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.tls_enabled = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.tls_keyfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cache.username = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] coordination.backend_url = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.asyncio_connection = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.asyncio_slave_connection = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.backend = sqlalchemy {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.connection = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.connection_debug = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.connection_parameters = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.connection_recycle_time = 3600 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.connection_trace = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.db_inc_retry_interval = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.db_max_retries = 20 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.db_max_retry_interval = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.db_retry_interval = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.max_overflow = 50 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.max_pool_size = 5 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.max_retries = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.pool_timeout = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.retry_interval = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.slave_connection = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.sqlite_synchronous = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.synchronous_reader = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] database.use_db_reconnect = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_tracing.insecure = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.connection_string = messaging:// {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.enabled = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.es_doc_type = notification {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.es_scroll_size = 10000 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.es_scroll_time = 2m {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.filter_error_trace = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.hmac_keys = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.sentinel_service_name = mymaster {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.socket_timeout = 0.1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.trace_requests = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler.trace_sqlalchemy = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler_jaeger.process_tags = {} {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] profiler_otlp.service_name_prefix = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_policy.enforce_new_defaults = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_policy.policy_default_rule = default {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_policy.policy_file = policy.yaml {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] privsep_osbrick.group = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] privsep_osbrick.helper_command = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] privsep_osbrick.user = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cinder_sys_admin.group = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cinder_sys_admin.helper_command = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] cinder_sys_admin.user = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.auth_section = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack quobyte-client[86203]: Reading configuration file: /etc/quobyte/client.cfg Nov 01 12:18:30 devstack quobyte-client[86203]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.auth_type = password {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.cafile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.certfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.collect_timing = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.insecure = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.keyfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.send_service_user_token = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.split_loggers = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.timeout = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.tls_ciphers = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] service_user.tls_min_version = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.auth_section = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.auth_type = password {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.certfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.collect_timing = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.insecure = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.keyfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] CMD "mount.quobyte" returned: 1 in 0.127s {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.region_name = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.split_loggers = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.timeout = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.tls_ciphers = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[86202]: INFO cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 ... Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 -c /etc/quobyte/client-cinder.cfg {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] glance.tls_min_version = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.backend_availability_zone = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.chap_password = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.chap_username = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.disk_geometry = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.driver_client_cert = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.driver_data_namespace = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.driver_use_ssl = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.extra_capabilities = {} {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.filter_function = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.goodness_function = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.iscsi_target_flags = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.iser_helper = tgtadm {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.iser_port = 3260 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nas_host = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nas_login = admin {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nas_mount_options = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nas_password = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nas_private_key = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nas_share_path = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack sudo[86208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 -c /etc/quobyte/client-cinder.cfg Nov 01 12:18:30 devstack sudo[86208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.quobyte_volume_url = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.replication_device = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.report_discard_supported = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.target_helper = tgtadm {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.target_port = 3260 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.target_protocol = iscsi {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.trace_flags = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.use_chap_auth = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.volume_backend_name = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.volume_clear = zero {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_reports.file_event_handler = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_reports.log_dir = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.backend_availability_zone = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.backend_host = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.chap_password = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.chap_username = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.chiscsi_conf = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.disk_geometry = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.driver_client_cert = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.driver_data_namespace = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.driver_use_ssl = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.extra_capabilities = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.filter_function = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.goodness_function = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.iser_helper = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.iser_ip_address = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.iser_port = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.iser_target_prefix = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nas_host = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nas_login = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nas_mount_options = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nas_password = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nas_private_key = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nas_share_path = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nas_ssh_port = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.num_shell_tries = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.nvmet_port_id = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.replication_device = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.report_discard_supported = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.reserved_percentage = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.scst_target_driver = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.storage_protocol = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.target_helper = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.target_ip_address = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.target_port = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.target_prefix = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.target_protocol = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.trace_flags = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.use_chap_auth = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.volume_clear = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.volume_clear_size = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] QuobyteHD.volumes_dir = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.ssl = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_notifications.driver = [] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] key_manager.fixed_key = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.barbican_api_version = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.barbican_endpoint = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.barbican_endpoint_type = public {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.barbican_region_name = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.cafile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.certfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.collect_timing = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.insecure = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.keyfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.number_of_retries = 60 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.retry_delay = 1 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.send_service_user_token = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.split_loggers = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.timeout = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.tls_ciphers = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.tls_min_version = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.verify_ssl = True {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican.verify_ssl_path = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.auth_section = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.auth_type = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.cafile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.certfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.collect_timing = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.insecure = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.keyfile = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.split_loggers = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.timeout = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.tls_ciphers = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] barbican_service_user.tls_min_version = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.approle_role_id = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.approle_secret_id = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.auth_method = approle {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.auth_path = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.kv_mountpoint = secret {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.kv_path = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.kv_version = 2 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.namespace = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.root_token_id = **** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.ssl_ca_crt_file = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.timeout = 60.0 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.token_file = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.token_role = None {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.use_ssl = False {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:30 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] ******************************************************************************** {{(pid=85984) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 12:18:30 devstack sudo[86208]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.456s {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:30 devstack cinder-volume[86202]: INFO cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 succeeded Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.468s {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:30 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:18:30 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:30 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.252s {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:30 devstack cinder-volume[86202]: INFO cinder.volume.driver [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Driver hasn't implemented _init_vendor_properties() Nov 01 12:18:30 devstack cinder-volume[86202]: DEBUG cinder.volume.driver [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9067420959473, 'free_capacity_gb': 1773.9067420959473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86202) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_db.sqlalchemy.engines [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86202) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG dbcounter [-] [86202] Writer thread running {{(pid=86202) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG cinder.db.api [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Building query based on filter {{(pid=86202) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG cinder.image.image_utils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86202) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 12:18:31 devstack cinder-volume[86202]: INFO cinder.keymgr.migration [None req-3bb2d515-e215-4235-ab53-a79e266f7b02 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:31 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:18:31 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:31 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.235s {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG cinder.manager [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Notifying Schedulers of capabilities ... {{(pid=86202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:18:31 devstack cinder-volume[86202]: INFO cinder.volume.manager [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Driver initialization completed successfully. Nov 01 12:18:31 devstack cinder-volume[86202]: INFO cinder.manager [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Initiating service 3 cleanup Nov 01 12:18:31 devstack cinder-volume[86202]: INFO cinder.manager [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Service 3 cleanup completed. Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG cinder.service [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Creating RPC server for service cinder-volume {{(pid=86202) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG cinder.service [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86202) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 12:18:31 devstack cinder-volume[86202]: INFO cinder.volume.manager [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG cinder.volume.drivers.quobyte [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:31 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:18:31 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:31 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:31 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.248s {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:31 devstack cinder-volume[86202]: INFO cinder.volume.manager [None req-8f614a7b-e5a8-426e-9990-cd8b730b81e9 None None] Driver post RPC initialization completed successfully. Nov 01 12:18:36 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-5493ad7e-7ea6-4804-995c-3e18bddd5816 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:36 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-5493ad7e-7ea6-4804-995c-3e18bddd5816 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:36 devstack cinder-volume[86202]: DEBUG cinder.volume.drivers.quobyte [None req-5493ad7e-7ea6-4804-995c-3e18bddd5816 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86202) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:36 devstack cinder-volume[86202]: DEBUG cinder.volume.drivers.quobyte [None req-5493ad7e-7ea6-4804-995c-3e18bddd5816 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86202) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:36 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-5493ad7e-7ea6-4804-995c-3e18bddd5816 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86202) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:36 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-5493ad7e-7ea6-4804-995c-3e18bddd5816 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:36 devstack sudo[86466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:18:36 devstack sudo[86466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:36 devstack sudo[86466]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:36 devstack cinder-volume[86202]: DEBUG oslo_concurrency.processutils [None req-5493ad7e-7ea6-4804-995c-3e18bddd5816 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.232s {{(pid=86202) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:36 devstack cinder-volume[86202]: DEBUG cinder.manager [None req-5493ad7e-7ea6-4804-995c-3e18bddd5816 None None] Notifying Schedulers of capabilities ... {{(pid=86202) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:18:36 devstack cinder-volume[85984]: INFO oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Caught SIGTERM, stopping children Nov 01 12:18:36 devstack cinder-volume[85984]: DEBUG oslo_concurrency.lockutils [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Acquiring lock "singleton_lock" {{(pid=85984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:18:36 devstack cinder-volume[85984]: DEBUG oslo_concurrency.lockutils [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Acquired lock "singleton_lock" {{(pid=85984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:18:36 devstack cinder-volume[85984]: DEBUG oslo_concurrency.lockutils [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Releasing lock "singleton_lock" {{(pid=85984) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:18:36 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Stop services. {{(pid=85984) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 01 12:18:36 devstack cinder-volume[85984]: DEBUG oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Killing children. {{(pid=85984) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 01 12:18:36 devstack cinder-volume[85984]: INFO oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Waiting on 1 children to exit Nov 01 12:18:39 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Acquiring lock "singleton_lock" {{(pid=86202) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:18:39 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Acquired lock "singleton_lock" {{(pid=86202) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:18:39 devstack cinder-volume[86202]: DEBUG oslo_concurrency.lockutils [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Releasing lock "singleton_lock" {{(pid=86202) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:18:39 devstack cinder-volume[86202]: WARNING amqp [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 12:18:39 devstack cinder-volume[86202]: WARNING amqp [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 12:18:39 devstack cinder-volume[85984]: INFO oslo_service.backend._eventlet.service [None req-31746af6-1315-4111-ab17-13bf916220d3 None None] Child 86202 exited with status 0 Nov 01 12:18:40 devstack cinder-volume[86518]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 12:18:40 devstack cinder-volume[86518]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 12:18:40 devstack cinder-volume[86518]: we strongly recommend against using it for new projects. Nov 01 12:18:40 devstack cinder-volume[86518]: If you are already using Eventlet, we recommend migrating to a different Nov 01 12:18:40 devstack cinder-volume[86518]: framework. For more detail see Nov 01 12:18:40 devstack cinder-volume[86518]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 12:18:40 devstack cinder-volume[86518]: import eventlet # noqa Nov 01 12:18:43 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:18:43 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:18:43 devstack cinder-volume[86518]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86518) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:18:43 devstack cinder-volume[86518]: INFO dbcounter [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Registered counter for database cinder Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_db.sqlalchemy.engines [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG dbcounter [-] [86518] Writer thread running {{(pid=86518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:18:44 devstack cinder-volume[86518]: INFO cinder.rpc [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 12:18:44 devstack cinder-volume[86518]: INFO cinder.rpc [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_db.sqlalchemy.engines [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:44 devstack cinder-volume[86518]: INFO cinder.volume.manager [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Determined volume DB was empty at startup. Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG cinder.volume.manager [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86518) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 12:18:44 devstack cinder-volume[86518]: WARNING stevedore.named [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 12:18:44 devstack cinder-volume[86518]: WARNING castellan.key_manager [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:18:44 devstack cinder-volume[86518]: WARNING cinder.keymgr.conf_key_mgr [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:18:44 devstack cinder-volume[86518]: INFO cinder.volume.manager [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_db.sqlalchemy.engines [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:44 devstack cinder-volume[86518]: INFO oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Starting 1 workers Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Started child 86812 {{(pid=86518) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Full set of CONF: {{(pid=86518) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] ******************************************************************************** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] Configuration options gathered from: {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] ================================================================================ {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] allow_availability_zone_fallback = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86812]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] allow_compression_on_image_upload = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] allowed_direct_url_schemes = [] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] api_rate_limit = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] auth_strategy = keystone {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_availability_zone = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_host = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_name = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_stats_polling_interval = 60 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backup_api_class = cinder.backup.api.API {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backup_name_template = backup-%s {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backup_use_same_host = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backup_use_temp_snapshot = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] chap_password = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] chap_username = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cinder_internal_tenant_project_id = 44d9c284f7764116861a40eefcf6c767 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cinder_internal_tenant_user_id = 50f326ae31f446c9afaacb7c30403aeb {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cluster = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] compression_format = gzip {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] compute_api_class = cinder.compute.nova.API {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] config_dir = [] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] config_source = [] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] control_exchange = openstack {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] debug = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] default_availability_zone = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] default_group_type = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] default_volume_type = QuobyteHD {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] disk_geometry = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] driver_client_cert = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] driver_client_cert_key = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] driver_data_namespace = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] driver_ssl_cert_path = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] driver_ssl_cert_verify = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] driver_use_ssl = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] enable_new_services = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] enable_unsupported_driver = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] enabled_backends = ['QuobyteHD'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] enforce_multipath_for_image_xfer = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] filter_function = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance_api_insecure = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance_api_ssl_compression = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance_ca_certificates_file = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance_catalog_info = image:glance:publicURL {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance_certfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance_keyfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance_num_retries = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance_request_timeout = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] goodness_function = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] graceful_shutdown_timeout = 5 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] group_api_class = cinder.group.api.API {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] host = devstack {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_compress_on_upload = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_conversion_address_space_limit = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_conversion_cpu_limit = 60 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_conversion_disable = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_introspection_address_space_limit = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_introspection_cpu_limit = 60 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_upload_use_cinder_backend = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_upload_use_internal_tenant = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_volume_cache_enabled = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_volume_cache_max_count = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] image_volume_cache_max_size_gb = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] init_host_max_objects_retrieval = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] instance_format = [instance: %(uuid)s] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] iscsi_target_flags = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] iscsi_write_cache = on {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] iser_helper = tgtadm {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] iser_ip_address = 192.168.122.240 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] iser_port = 3260 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86812) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] log_color = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] log_config_append = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] log_dir = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] log_file = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] log_options = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] log_rotate_interval = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] log_rotate_interval_type = days {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] log_rotation_type = none {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] max_age = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] max_logfile_count = 30 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] max_logfile_size_mb = 200 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] max_over_subscription_ratio = 20.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] message_reap_interval = 86400 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] message_ttl = 2592000 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] migration_create_volume_timeout_secs = 300 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] monkey_patch = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] monkey_patch_modules = [] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] my_ip = 192.168.122.240 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] no_snapshot_gb_quota = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] num_iser_scan_tries = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] num_shell_tries = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] num_volume_device_scan_tries = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] nvmeof_conn_info_version = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] nvmet_ns_id = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] nvmet_port_id = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] osapi_max_limit = 1000 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] osapi_volume_ext_list = [] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] osapi_volume_listen = 0.0.0.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] osapi_volume_listen_port = 8776 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] osapi_volume_use_ssl = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] osapi_volume_workers = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] per_volume_size_limit = -1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] periodic_fuzzy_delay = 60 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] periodic_interval = 60 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] project_id_regex = [0-9a-f\-]+ {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] public_endpoint = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] publish_errors = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] quota_backup_gigabytes = 1000 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] quota_backups = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] quota_gigabytes = 1000 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] quota_groups = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] quota_snapshots = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] quota_volumes = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] rate_limit_burst = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] rate_limit_except_level = CRITICAL {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] rate_limit_interval = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] reinit_driver_count = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] replication_device = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] report_discard_supported = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] report_interval = 120 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] reservation_clean_interval = 86400 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] reservation_expire = 86400 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] reserved_image_namespaces = [] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] reserved_percentage = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] rpc_response_timeout = 120 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] run_external_periodic_tasks = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] scst_target_driver = iscsi {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] scst_target_iqn_name = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_down_time = 720 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] shell_completion = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] snapshot_name_template = snapshot-%s {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] split_loggers = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] state_path = /opt/stack/data/cinder {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] storage_availability_zone = nova {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] storage_protocol = iSCSI {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] syslog_log_facility = LOG_USER {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] target_helper = lioadm {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] target_ip_address = 192.168.122.240 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] target_port = 3260 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] target_protocol = iscsi {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] target_secondary_ip_addresses = [] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] trace_flags = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] transfer_api_class = cinder.transfer.api.API {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] transport_url = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] until_refresh = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] use_chap_auth = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] use_default_quota_class = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] use_journal = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] use_json = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] use_multipath_for_image_xfer = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] use_stderr = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] use_syslog = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] verify_glance_signatures = enabled {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_api_class = cinder.volume.api.API {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_backend_name = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_clear = zero {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_clear_ionice = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_clear_size = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_copy_bps_limit = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_dd_blocksize = 1M {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_name_template = volume-%s {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_service_inithost_offload = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volume_usage_audit_period = month {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] zoning_mode = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_concurrency.disable_process_locking = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.auth_section = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.auth_type = password {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.auth_version = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.cache = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.certfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.delay_auth_decision = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86812) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 01 12:18:44 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.quobyte [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 01 12:18:44 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.quobyte [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.http_connect_timeout = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.include_service_catalog = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.insecure = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.interface = public {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.keyfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_password = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Running cmd (subprocess): mount.quobyte {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcache_username = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.region_name = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.service_token_roles_required = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.service_type = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.token_cache_time = 300 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.backend = dogpile.cache.null {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.backend_argument = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.backend_expiration_time = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.config_prefix = cache.oslo {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.debug_cache_backend = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.enable_retry_client = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.enable_socket_keepalive = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.enabled = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.expiration_time = 600 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.hashclient_retry_attempts = 2 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.memcache_dead_retry = 300 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.memcache_pool_maxsize = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.memcache_sasl_enabled = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.password = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.proxies = [] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.redis_db = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.redis_sentinel_service_name = mymaster {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.redis_server = localhost:6379 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.retry_attempts = 2 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.retry_delay = 0.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.socket_keepalive_count = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.socket_keepalive_idle = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.socket_keepalive_interval = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.socket_timeout = 1.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.tls_allowed_ciphers = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.tls_cafile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.tls_certfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.tls_enabled = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.tls_keyfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cache.username = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] coordination.backend_url = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.asyncio_connection = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.asyncio_slave_connection = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.backend = sqlalchemy {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.connection = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.connection_debug = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.connection_parameters = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.connection_recycle_time = 3600 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.connection_trace = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.db_inc_retry_interval = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.db_max_retries = 20 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.db_max_retry_interval = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.db_retry_interval = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.max_overflow = 50 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.max_pool_size = 5 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.max_retries = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.mysql_wsrep_sync_wait = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.pool_timeout = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.retry_interval = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.slave_connection = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.sqlite_synchronous = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.synchronous_reader = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] database.use_db_reconnect = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_tracing.insecure = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.connection_string = messaging:// {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.enabled = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.es_doc_type = notification {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.es_scroll_size = 10000 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.es_scroll_time = 2m {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.filter_error_trace = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.hmac_keys = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.sentinel_service_name = mymaster {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.socket_timeout = 0.1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.trace_requests = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler.trace_sqlalchemy = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler_jaeger.process_tags = {} {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler_jaeger.service_name_prefix = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] profiler_otlp.service_name_prefix = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_policy.enforce_new_defaults = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_policy.policy_default_rule = default {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_policy.policy_file = policy.yaml {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_policy.remote_timeout = 60.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] privsep_osbrick.group = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] privsep_osbrick.helper_command = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] privsep_osbrick.user = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cinder_sys_admin.group = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cinder_sys_admin.helper_command = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] cinder_sys_admin.user = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.auth_section = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.auth_type = password {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack quobyte-client[86815]: Reading configuration file: /etc/quobyte/client.cfg Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.cafile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.certfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.collect_timing = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.insecure = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.keyfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.send_service_user_token = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.split_loggers = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack quobyte-client[86815]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.timeout = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.tls_ciphers = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] service_user.tls_min_version = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.auth_section = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.auth_type = password {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.certfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.collect_timing = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.insecure = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.keyfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.region_name = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.split_loggers = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.timeout = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.tls_ciphers = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] glance.tls_min_version = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.backend_availability_zone = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.chap_password = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.chap_username = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.disk_geometry = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.driver_client_cert = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.driver_client_cert_key = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.driver_data_namespace = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.driver_use_ssl = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.enable_unsupported_driver = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.extra_capabilities = {} {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.filter_function = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.goodness_function = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.iscsi_target_flags = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.iscsi_write_cache = on {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.iser_helper = tgtadm {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.iser_port = 3260 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nas_host = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nas_login = admin {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nas_mount_options = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nas_password = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nas_private_key = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nas_share_path = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nas_ssh_port = 22 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.num_shell_tries = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.nvmet_port_id = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.quobyte_client_cfg = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.quobyte_volume_url = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.replication_device = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.report_discard_supported = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.reserved_percentage = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.scst_target_driver = iscsi {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.scst_target_iqn_name = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.storage_protocol = iSCSI {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.target_helper = tgtadm {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.target_port = 3260 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.target_protocol = iscsi {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.trace_flags = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.unique_fqdn_network = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.use_chap_auth = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.volume_backend_name = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.volume_clear = zero {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.volume_clear_ionice = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.volume_clear_size = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_reports.file_event_handler = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_reports.log_dir = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.backend_availability_zone = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.backend_host = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.chap_password = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.chap_username = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.chiscsi_conf = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.disk_geometry = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.driver_client_cert = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.driver_client_cert_key = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.driver_data_namespace = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.driver_use_ssl = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.extra_capabilities = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.filter_function = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.goodness_function = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.iscsi_target_flags = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.iscsi_write_cache = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.iser_helper = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.iser_ip_address = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.iser_port = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.iser_target_prefix = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nas_host = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nas_login = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nas_mount_options = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nas_password = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nas_private_key = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nas_share_path = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nas_ssh_port = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.num_shell_tries = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nvmet_ns_id = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.nvmet_port_id = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.replication_device = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.report_discard_supported = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.reserved_percentage = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.scst_target_driver = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.storage_protocol = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.target_helper = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.target_ip_address = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.target_port = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.target_prefix = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.target_protocol = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.trace_flags = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.unique_fqdn_network = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.use_chap_auth = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.volume_clear = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.volume_clear_ionice = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.volume_clear_size = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] QuobyteHD.volumes_dir = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.ssl = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.ssl_version = {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_notifications.driver = [] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_notifications.retry = -1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] oslo_messaging_notifications.transport_url = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] key_manager.fixed_key = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.barbican_api_version = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.barbican_endpoint = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.barbican_endpoint_type = public {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.barbican_region_name = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.cafile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.certfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.collect_timing = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.insecure = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.keyfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.number_of_retries = 60 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.retry_delay = 1 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.send_service_user_token = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.split_loggers = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.timeout = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.tls_ciphers = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.tls_min_version = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.verify_ssl = True {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican.verify_ssl_path = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.auth_section = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.auth_type = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.cafile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.certfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.collect_timing = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.insecure = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.keyfile = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.split_loggers = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.timeout = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.tls_ciphers = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] barbican_service_user.tls_min_version = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.approle_role_id = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.approle_secret_id = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.auth_method = approle {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.auth_path = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.kv_mountpoint = secret {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.kv_path = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.kv_version = 2 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.namespace = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.root_token_id = **** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.ssl_ca_crt_file = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.timeout = 60.0 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.token_file = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.token_role = None {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.use_ssl = False {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:44 devstack cinder-volume[86518]: DEBUG oslo_service.backend._eventlet.service [None req-a231ea4a-dadb-417e-8782-fd8a34d64dbe None None] ******************************************************************************** {{(pid=86518) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 12:18:45 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.278s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:45 devstack cinder-volume[86812]: INFO cinder.volume.driver [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Driver hasn't implemented _init_vendor_properties() Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG cinder.volume.driver [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9067420959473, 'free_capacity_gb': 1773.9067420959473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86812) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_db.sqlalchemy.engines [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86812) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writer thread running {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG cinder.db.api [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Building query based on filter {{(pid=86812) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86812) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:45 devstack cinder-volume[86812]: INFO cinder.keymgr.migration [None req-55712ae3-14d3-446e-ba93-b8ee1510c75f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 12:18:45 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:18:45 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:45 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:18:45 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Driver initialization completed successfully. Nov 01 12:18:45 devstack cinder-volume[86812]: INFO cinder.manager [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Initiating service 3 cleanup Nov 01 12:18:45 devstack cinder-volume[86812]: INFO cinder.manager [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Service 3 cleanup completed. Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG cinder.service [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Creating RPC server for service cinder-volume {{(pid=86812) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG cinder.service [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86812) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 12:18:45 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:45 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:18:45 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:45 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.233s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:45 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-89b978f7-28ba-43c5-b0ba-c89a22e5a7e0 None None] Driver post RPC initialization completed successfully. Nov 01 12:18:54 devstack cinder-volume[86518]: DEBUG dbcounter [-] [86518] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:18:55 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:18:55 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=2 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:19:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:19:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 6 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:19:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Flow 'volume_create_manager' (d3c451e0-14c4-48fc-afbf-285c2f8774d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b118cb3-a614-4b71-b875-6a2eb8fed203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b118cb3-a614-4b71-b875-6a2eb8fed203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1434244639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241c646b-97b4-40fc-b82f-85524a75bb8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418fadfc633a47c88917ec2ef2c0db89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:11Z,use_quota=True,user_id='c9dfc2b93e1d42efa81b2122bbb14c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e357c4c2-ad8a-4f49-9957-3288010746ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e357c4c2-ad8a-4f49-9957-3288010746ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c669b7-3218-4fd7-a7f9-4de18329a786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16c669b7-3218-4fd7-a7f9-4de18329a786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241c646b-97b4-40fc-b82f-85524a75bb8d', 'volume_name': 'volume-241c646b-97b4-40fc-b82f-85524a75bb8d', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf23980-f720-45f2-9122-7de57301d4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf23980-f720-45f2-9122-7de57301d4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df62278b-6bc5-4434-b57e-0e01ee43facd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:11 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Volume 241c646b-97b4-40fc-b82f-85524a75bb8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241c646b-97b4-40fc-b82f-85524a75bb8d', 'volume_size': 1} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1434244639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241c646b-97b4-40fc-b82f-85524a75bb8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418fadfc633a47c88917ec2ef2c0db89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:11Z,use_quota=True,user_id='c9dfc2b93e1d42efa81b2122bbb14c06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Creating volume 241c646b-97b4-40fc-b82f-85524a75bb8d {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:20:12 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:20:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:12 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d 1073741824 Nov 01 12:20:12 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:13 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d 1073741824" returned: 0 in 1.310s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:13 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d Nov 01 12:20:13 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:14 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d" returned: 0 in 0.718s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:20:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df62278b-6bc5-4434-b57e-0e01ee43facd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241c646b-97b4-40fc-b82f-85524a75bb8d', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7de6e9-02e2-43de-9e3b-f618974bf344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:14 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Volume volume-241c646b-97b4-40fc-b82f-85524a75bb8d (241c646b-97b4-40fc-b82f-85524a75bb8d): created successfully Nov 01 12:20:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7de6e9-02e2-43de-9e3b-f618974bf344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Flow 'volume_create_manager' (d3c451e0-14c4-48fc-afbf-285c2f8774d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:14 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-661e57a4-905d-44c9-9b8a-cdd88051fc78 tempest-VolumesAdminNegativeTest-1911964868 None] Created volume successfully. Nov 01 12:20:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Acquiring lock "cinder-241c646b-97b4-40fc-b82f-85524a75bb8d-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Lock "cinder-241c646b-97b4-40fc-b82f-85524a75bb8d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Acquiring lock "cinder-quobyte-241c646b-97b4-40fc-b82f-85524a75bb8d" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Lock "cinder-quobyte-241c646b-97b4-40fc-b82f-85524a75bb8d" acquired by "delete_volume" :: waited 0.056s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:16 devstack cinder-volume[86812]: INFO oslo.privsep.daemon [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpswi7wves/privsep.sock'] Nov 01 12:20:16 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpswi7wves/privsep.sock Nov 01 12:20:16 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Flow 'volume_create_manager' (e4afe6a6-2958-4df2-85a4-adaa0839c46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fed218-22eb-4e6f-b0d3-9ecd9f468705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fed218-22eb-4e6f-b0d3-9ecd9f468705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-168511898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9702b41-bd41-418d-b003-54ffbd412844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1716f0d3c2040e5a8606df84a0bb964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:18Z,use_quota=True,user_id='aad98477c8fb43cdaab797fb43b7c7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cb5495-d7b3-4a31-a14b-9e6ef203c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cb5495-d7b3-4a31-a14b-9e6ef203c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca38a77-ab41-4cff-8cd7-4f9ac65371b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dca38a77-ab41-4cff-8cd7-4f9ac65371b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9702b41-bd41-418d-b003-54ffbd412844', 'volume_name': 'volume-e9702b41-bd41-418d-b003-54ffbd412844', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0722858b-4159-4750-b78e-41009b3c7e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0722858b-4159-4750-b78e-41009b3c7e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13258539-fd1d-4569-80a5-05fa9c5a08ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:17 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Volume e9702b41-bd41-418d-b003-54ffbd412844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9702b41-bd41-418d-b003-54ffbd412844', 'volume_size': 1} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-168511898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9702b41-bd41-418d-b003-54ffbd412844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1716f0d3c2040e5a8606df84a0bb964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:18Z,use_quota=True,user_id='aad98477c8fb43cdaab797fb43b7c7da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Creating volume e9702b41-bd41-418d-b003-54ffbd412844 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:20:17 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:20:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:18 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844 1073741824 Nov 01 12:20:18 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:18 devstack cinder-volume[86812]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 01 12:20:18 devstack cinder-volume[86812]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 12:20:18 devstack cinder-volume[86812]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 01 12:20:18 devstack cinder-volume[86812]: WARNING oslo.privsep.daemon [-] privsep log: Nov 01 12:20:18 devstack cinder-volume[86812]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 01 12:20:18 devstack cinder-volume[86812]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 01 12:20:18 devstack cinder-volume[86812]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 12:20:18 devstack cinder-volume[86812]: WARNING oslo.privsep.daemon [-] privsep log: Nov 01 12:20:18 devstack cinder-volume[86812]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 01 12:20:19 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:19 devstack cinder-volume[86812]: INFO oslo.privsep.daemon [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Spawned new privsep daemon via rootwrap Nov 01 12:20:19 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Accepted privsep connection to /tmp/tmpswi7wves/privsep.sock {{(pid=86812) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 01 12:20:19 devstack cinder-volume[86812]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 01 12:20:19 devstack cinder-volume[86812]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 01 12:20:19 devstack cinder-volume[86812]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 01 12:20:19 devstack cinder-volume[86812]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88222 Nov 01 12:20:19 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2494ce94-8d35-4843-a56f-0ffd7683a47f]: (2,) {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:20:19 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06f503e-075c-42df-9aff-ffc33409ca3b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:20:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:19 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d Nov 01 12:20:19 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:19 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844 1073741824" returned: 0 in 1.540s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:19 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844 Nov 01 12:20:19 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:20 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844" returned: 0 in 1.198s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] <== create_volume: return (2887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:20:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.903s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:20 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d" returned: 0 in 1.752s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13258539-fd1d-4569-80a5-05fa9c5a08ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9702b41-bd41-418d-b003-54ffbd412844', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b95a48a-408f-4bc8-8b08-049e80f078be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:20 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Volume volume-e9702b41-bd41-418d-b003-54ffbd412844 (e9702b41-bd41-418d-b003-54ffbd412844): created successfully Nov 01 12:20:20 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d Nov 01 12:20:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b95a48a-408f-4bc8-8b08-049e80f078be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:20 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Flow 'volume_create_manager' (e4afe6a6-2958-4df2-85a4-adaa0839c46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:20 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-fe92bc34-6daa-431b-a8dd-d77404bb2d57 tempest-ServerRescueNegativeTestJSON-305688925 None] Created volume successfully. Nov 01 12:20:22 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-241c646b-97b4-40fc-b82f-85524a75bb8d" returned: 0 in 1.332s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Lock "cinder-quobyte-241c646b-97b4-40fc-b82f-85524a75bb8d" released by "delete_volume" :: held 5.947s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:22 devstack cinder-volume[86812]: WARNING cinder.quota [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:20:22 devstack cinder-volume[86812]: WARNING cinder.quota [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:20:22 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Created reservations ['17132c58-e5f9-4113-a91c-3428c9d7a513', '86bad5f4-53e7-444d-a38e-a43c55220299', '93ad8409-bca5-4cf1-8b45-0c6da00c0367', '1d418187-1ff6-42e9-9410-47ab84cef583'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:20:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:23 devstack sudo[88271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:20:23 devstack sudo[88271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:23 devstack sudo[88271]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.730s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:23 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:20:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Deleted volume successfully. Nov 01 12:20:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2eaa5cdb-565f-4274-9bb0-338462b75793 tempest-VolumesAdminNegativeTest-1911964868 None] Lock "cinder-241c646b-97b4-40fc-b82f-85524a75bb8d-delete_volume" released by "delete_volume" :: held 7.743s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:29 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Flow 'volume_create_manager' (f6468b02-acae-46c1-9962-dee2448ff884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2880d5-7dea-471b-9ade-165f7a3912eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2880d5-7dea-471b-9ade-165f7a3912eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-853383243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7730fb1f-9b75-4758-b5fc-e36fcc68cffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cabb7529c7047069835282e73e451dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:30Z,use_quota=True,user_id='1cce0e4530dd4dcaaa7e9e2816cfda93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3dea787-b4c3-49a7-a246-ad11bf01f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3dea787-b4c3-49a7-a246-ad11bf01f453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33306951-f2e6-44fb-93bf-bfab755ecf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33306951-f2e6-44fb-93bf-bfab755ecf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7730fb1f-9b75-4758-b5fc-e36fcc68cffc', 'volume_name': 'volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c07c78-4fd0-40c4-ba00-02e47d4f45e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c07c78-4fd0-40c4-ba00-02e47d4f45e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705079d8-b994-4b07-897d-a4e76dcff23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:30 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Volume 7730fb1f-9b75-4758-b5fc-e36fcc68cffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc', 'volume_size': 1} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-853383243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7730fb1f-9b75-4758-b5fc-e36fcc68cffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cabb7529c7047069835282e73e451dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:30Z,use_quota=True,user_id='1cce0e4530dd4dcaaa7e9e2816cfda93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Creating volume 7730fb1f-9b75-4758-b5fc-e36fcc68cffc {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:20:30 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:30 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc 1073741824 Nov 01 12:20:30 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:30 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc 1073741824" returned: 0 in 0.639s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:30 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc Nov 01 12:20:30 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:31 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc" returned: 0 in 0.332s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:20:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705079d8-b994-4b07-897d-a4e76dcff23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9806b69-75dd-4e29-9c9a-026268078c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:31 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Volume volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc (7730fb1f-9b75-4758-b5fc-e36fcc68cffc): created successfully Nov 01 12:20:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9806b69-75dd-4e29-9c9a-026268078c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Flow 'volume_create_manager' (f6468b02-acae-46c1-9962-dee2448ff884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:31 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f63230ac-8485-4370-8cc2-b45af54bd8b9 tempest-ServersNegativeTestJSON-717586320 None] Created volume successfully. Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Flow 'volume_create_manager' (85bb575c-0da1-40c1-aebe-d501f4fb8439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb95506-2515-491e-aee9-8dd3d12d6dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb95506-2515-491e-aee9-8dd3d12d6dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1673978179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdacf18-61fb-46d7-91f2-a7a52d157e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cabb7529c7047069835282e73e451dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:34Z,use_quota=True,user_id='1cce0e4530dd4dcaaa7e9e2816cfda93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f284234-c614-46cc-9e1f-db10fecbfe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f284234-c614-46cc-9e1f-db10fecbfe9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a3ce6f-e434-48bc-82dc-c3c993e7834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a3ce6f-e434-48bc-82dc-c3c993e7834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cdacf18-61fb-46d7-91f2-a7a52d157e93', 'volume_name': 'volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6885b5a3-7699-4b47-bb1d-ea750873a458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6885b5a3-7699-4b47-bb1d-ea750873a458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c67d8da1-a4fc-4ecc-ae69-d71386fd92f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:34 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Volume 0cdacf18-61fb-46d7-91f2-a7a52d157e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93', 'volume_size': 1} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1673978179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdacf18-61fb-46d7-91f2-a7a52d157e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cabb7529c7047069835282e73e451dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:34Z,use_quota=True,user_id='1cce0e4530dd4dcaaa7e9e2816cfda93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Creating volume 0cdacf18-61fb-46d7-91f2-a7a52d157e93 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:20:34 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:20:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:34 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93 1073741824 Nov 01 12:20:34 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:35 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93 1073741824" returned: 0 in 0.633s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:35 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93 Nov 01 12:20:35 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:35 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93" returned: 0 in 0.393s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:20:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c67d8da1-a4fc-4ecc-ae69-d71386fd92f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33279410-c285-4fce-8ed5-437384c576a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:35 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Volume volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93 (0cdacf18-61fb-46d7-91f2-a7a52d157e93): created successfully Nov 01 12:20:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33279410-c285-4fce-8ed5-437384c576a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Flow 'volume_create_manager' (85bb575c-0da1-40c1-aebe-d501f4fb8439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3952f783-7abe-4886-84c7-fa693c14907a tempest-ServersNegativeTestJSON-717586320 None] Created volume successfully. Nov 01 12:20:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Acquiring lock "cinder-e9702b41-bd41-418d-b003-54ffbd412844-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Lock "cinder-e9702b41-bd41-418d-b003-54ffbd412844-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:20:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Acquiring lock "cinder-quobyte-e9702b41-bd41-418d-b003-54ffbd412844" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:37 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:20:37 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Lock "cinder-quobyte-e9702b41-bd41-418d-b003-54ffbd412844" acquired by "delete_volume" :: waited 0.045s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc7cb33-139c-4159-9696-5167f7b05c4f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:37 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844 Nov 01 12:20:37 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:37 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844" returned: 0 in 0.530s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:37 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.750s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:20:37 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844 Nov 01 12:20:37 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 8 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:20:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Acquiring lock "cinder-0cdacf18-61fb-46d7-91f2-a7a52d157e93-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Lock "cinder-0cdacf18-61fb-46d7-91f2-a7a52d157e93-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Acquiring lock "cinder-quobyte-0cdacf18-61fb-46d7-91f2-a7a52d157e93" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Lock "cinder-quobyte-0cdacf18-61fb-46d7-91f2-a7a52d157e93" acquired by "delete_volume" :: waited 0.052s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:38 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9702b41-bd41-418d-b003-54ffbd412844" returned: 0 in 0.583s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8894648-fde8-405a-8e31-85305055884b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Lock "cinder-quobyte-e9702b41-bd41-418d-b003-54ffbd412844" released by "delete_volume" :: held 1.288s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Created reservations ['9227b0c0-a497-468d-b943-690ab401870a', '383b04c8-ec40-43d5-81d4-62c789eeb61b', '02ee7e18-c1a6-43b8-9c9d-fa7dc2c41798', 'b6858c69-02a3-4d07-b7e6-7710dfcce519'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:20:38 devstack sudo[88431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93 Nov 01 12:20:38 devstack sudo[88431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:38 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:20:38 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:39 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.374s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:39 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:20:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Deleted volume successfully. Nov 01 12:20:39 devstack sudo[88431]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93" returned: 0 in 0.766s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f38a3418-2cf6-4496-a1ae-ed222be3c6a7 tempest-ServerRescueNegativeTestJSON-305688925 None] Lock "cinder-e9702b41-bd41-418d-b003-54ffbd412844-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:39 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93 Nov 01 12:20:39 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:39 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0cdacf18-61fb-46d7-91f2-a7a52d157e93" returned: 0 in 0.779s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Lock "cinder-quobyte-0cdacf18-61fb-46d7-91f2-a7a52d157e93" released by "delete_volume" :: held 1.669s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:39 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Created reservations ['fe15a192-3955-4284-bef0-5f815879157e', 'cf2efe88-63de-4d27-b8cf-d693823f6a54', 'b50e61a2-dc29-4adc-bded-06b99dd95cb0', 'b4a8df58-8b26-4102-95cd-024ca1c5d43f'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:40 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:20:40 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Acquiring lock "cinder-7730fb1f-9b75-4758-b5fc-e36fcc68cffc-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:40 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.490s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:20:40 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Deleted volume successfully. Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Lock "cinder-7730fb1f-9b75-4758-b5fc-e36fcc68cffc-delete_volume" acquired by "delete_volume" :: waited 0.152s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2d32eb34-db20-4f5d-b0ed-8222d56253f4 tempest-ServersNegativeTestJSON-717586320 None] Lock "cinder-0cdacf18-61fb-46d7-91f2-a7a52d157e93-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Acquiring lock "cinder-quobyte-7730fb1f-9b75-4758-b5fc-e36fcc68cffc" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Lock "cinder-quobyte-7730fb1f-9b75-4758-b5fc-e36fcc68cffc" acquired by "delete_volume" :: waited 0.048s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ad5e62-e35b-46ef-8663-4d2797cf037b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:20:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:41 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc Nov 01 12:20:41 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:41 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc" returned: 0 in 0.773s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:41 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc Nov 01 12:20:41 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:42 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7730fb1f-9b75-4758-b5fc-e36fcc68cffc" returned: 0 in 0.428s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Lock "cinder-quobyte-7730fb1f-9b75-4758-b5fc-e36fcc68cffc" released by "delete_volume" :: held 1.286s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Created reservations ['26dd35ef-6a74-4ab9-9c86-97ed2a86d2ed', '543ba384-c470-4eb4-bea8-4049f64eafbb', '22662221-6694-48c6-a226-255a87e4347f', '79f987f0-4542-49fa-98be-c09b67836dab'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:42 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:20:42 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:42 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.393s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:20:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Deleted volume successfully. Nov 01 12:20:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0665a5de-d5c0-4a9f-b30a-6d8bc026c90a tempest-ServersNegativeTestJSON-717586320 None] Lock "cinder-7730fb1f-9b75-4758-b5fc-e36fcc68cffc-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:55 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=47,cinder:SELECT=32,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:20:55 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=25,cinder:UPDATE=42,cinder:DELETE=5,cinder:INSERT=8 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:21:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e831ca1-602b-422e-bda0-5cf6c8d0a6ff tempest-BackendsCapabilitiesAdminTestsJSON-1235227960 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9067420959473, 'free_capacity_gb': 1773.9067420959473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86812) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 12:21:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-098fa2d0-638a-48b9-84ff-acac6a0630e6 tempest-BackendsCapabilitiesAdminTestsJSON-1235227960 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9067420959473, 'free_capacity_gb': 1773.9067420959473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86812) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Flow 'volume_create_manager' (7f0f85f9-59a9-469e-8d44-f14c08fa3d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b02cd8-dd59-40ad-b920-a14384ca7fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b02cd8-dd59-40ad-b920-a14384ca7fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-508764854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d9a6b2-6aa9-44b5-997b-1eafbb13578f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed69bbd9b05a4028b344ca9abc6b32ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:16Z,use_quota=True,user_id='e868e164da734330878cf3c3eec72adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41aef76d-90ca-4139-b635-d27697533ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41aef76d-90ca-4139-b635-d27697533ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafdb1aa-8009-469e-a5e1-a44368fd319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fafdb1aa-8009-469e-a5e1-a44368fd319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d9a6b2-6aa9-44b5-997b-1eafbb13578f', 'volume_name': 'volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af225565-a251-4ed7-b25d-eef29a656e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af225565-a251-4ed7-b25d-eef29a656e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6ab4d6-4c94-4198-9077-b8f00f6e9f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:16 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Volume d1d9a6b2-6aa9-44b5-997b-1eafbb13578f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f', 'volume_size': 1} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-508764854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d9a6b2-6aa9-44b5-997b-1eafbb13578f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed69bbd9b05a4028b344ca9abc6b32ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:16Z,use_quota=True,user_id='e868e164da734330878cf3c3eec72adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Creating volume d1d9a6b2-6aa9-44b5-997b-1eafbb13578f {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:21:16 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:16 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f 1073741824 Nov 01 12:21:16 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:16 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f 1073741824" returned: 0 in 0.537s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:16 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f Nov 01 12:21:16 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:17 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f" returned: 0 in 0.468s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:21:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6ab4d6-4c94-4198-9077-b8f00f6e9f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4e3024-9852-4b7e-8996-6f20d3540f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:17 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Volume volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f (d1d9a6b2-6aa9-44b5-997b-1eafbb13578f): created successfully Nov 01 12:21:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4e3024-9852-4b7e-8996-6f20d3540f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Flow 'volume_create_manager' (7f0f85f9-59a9-469e-8d44-f14c08fa3d76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:17 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-22c5b362-a5d9-419a-a0fb-aafafccd1e7c tempest-DeleteServersTestJSON-1801771082 None] Created volume successfully. Nov 01 12:21:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4611c49a-8dd0-4f9b-89ee-53a37466a8f0 tempest-GroupSnapshotsV319Test-202244773 None] Group tempest-GroupSnapshotsV319Test-Group-313726416: creating Nov 01 12:21:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4611c49a-8dd0-4f9b-89ee-53a37466a8f0 tempest-GroupSnapshotsV319Test-202244773 None] Group tempest-GroupSnapshotsV319Test-Group-313726416: created successfully Nov 01 12:21:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4611c49a-8dd0-4f9b-89ee-53a37466a8f0 tempest-GroupSnapshotsV319Test-202244773 None] Create group completed successfully. Nov 01 12:21:22 devstack cinder-volume[86812]: WARNING py.warnings [req-ad345fc3-fdb8-4410-a5fd-a24508b01f0e req-04d274fe-68ba-4df3-919c-ccebf6c58230 tempest-DeleteServersTestJSON-1801771082 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 01 12:21:22 devstack cinder-volume[86812]: .first() Nov 01 12:21:22 devstack cinder-volume[86812]: Nov 01 12:21:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-ad345fc3-fdb8-4410-a5fd-a24508b01f0e req-04d274fe-68ba-4df3-919c-ccebf6c58230 tempest-DeleteServersTestJSON-1801771082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-ad345fc3-fdb8-4410-a5fd-a24508b01f0e req-04d274fe-68ba-4df3-919c-ccebf6c58230 tempest-DeleteServersTestJSON-1801771082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-ad345fc3-fdb8-4410-a5fd-a24508b01f0e req-04d274fe-68ba-4df3-919c-ccebf6c58230 tempest-DeleteServersTestJSON-1801771082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-ad345fc3-fdb8-4410-a5fd-a24508b01f0e req-04d274fe-68ba-4df3-919c-ccebf6c58230 tempest-DeleteServersTestJSON-1801771082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ea22d68-05c9-482a-96e6-32699259fb99', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:21:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-ad345fc3-fdb8-4410-a5fd-a24508b01f0e req-04d274fe-68ba-4df3-919c-ccebf6c58230 tempest-DeleteServersTestJSON-1801771082 None] attachment_update completed successfully. Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Flow 'volume_create_manager' (043bd4bf-5c70-44f2-878c-a03b5e23f919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb96222a-c87d-455e-adea-1698f2b5c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb96222a-c87d-455e-adea-1698f2b5c452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1743654014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b35e42f8-3fae-4749-8de3-7849a2fd86a0,host='devstack@QuobyteHD#QuobyteHD',id=1d46c2e8-3c4d-46b6-9738-c967d68eece9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03110637085a4430b0c03061df9086d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:24Z,use_quota=True,user_id='d3d0e6b7903a4a06bbb4e886c99feecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41425946-c6b2-476a-b9c1-6b1afc073842),volume_type_id=41425946-c6b2-476a-b9c1-6b1afc073842)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be6740f-2720-4540-ad3f-b9f1bcfc9d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be6740f-2720-4540-ad3f-b9f1bcfc9d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a35c96b-cd3f-4fb5-9576-e0b2fddcd411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a35c96b-cd3f-4fb5-9576-e0b2fddcd411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d46c2e8-3c4d-46b6-9738-c967d68eece9', 'volume_name': 'volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7feb2a41-3d98-40f4-a23e-577112fb8bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7feb2a41-3d98-40f4-a23e-577112fb8bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172c64e0-de8e-4d8f-ad78-e8fd0b96fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:24 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Volume 1d46c2e8-3c4d-46b6-9738-c967d68eece9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9', 'volume_size': 1} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b35e42f8-3fae-4749-8de3-7849a2fd86a0,created_at=2026-11-01T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1743654014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b35e42f8-3fae-4749-8de3-7849a2fd86a0,host='devstack@QuobyteHD#QuobyteHD',id=1d46c2e8-3c4d-46b6-9738-c967d68eece9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03110637085a4430b0c03061df9086d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:24Z,use_quota=True,user_id='d3d0e6b7903a4a06bbb4e886c99feecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41425946-c6b2-476a-b9c1-6b1afc073842),volume_type_id=41425946-c6b2-476a-b9c1-6b1afc073842)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Creating volume 1d46c2e8-3c4d-46b6-9738-c967d68eece9 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:21:24 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:24 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 1073741824 Nov 01 12:21:24 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:24 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 1073741824" returned: 0 in 0.675s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:25 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 Nov 01 12:21:25 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:25 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9" returned: 0 in 0.436s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:21:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172c64e0-de8e-4d8f-ad78-e8fd0b96fec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41999f7f-1470-4d01-baf4-37801ad217fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Volume volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 (1d46c2e8-3c4d-46b6-9738-c967d68eece9): created successfully Nov 01 12:21:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41999f7f-1470-4d01-baf4-37801ad217fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Flow 'volume_create_manager' (043bd4bf-5c70-44f2-878c-a03b5e23f919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a04e861a-89d1-4f48-8031-7719cd739e39 tempest-GroupSnapshotsV319Test-202244773 None] Created volume successfully. Nov 01 12:21:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] GroupSnapshot bc54330b-713e-40c4-9182-466fac344329: creating. Nov 01 12:21:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Group snapshot bc54330b-713e-40c4-9182-466fac344329: creating. {{(pid=86812) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 12:21:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Creating offline snapshot f59ef9a6-05ef-4423-8c54-891a5fbff6e4 of volume 1d46c2e8-3c4d-46b6-9738-c967d68eece9 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:21:27 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b762ac85-5ae7-48d3-9d06-36677f499289]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:27 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 Nov 01 12:21:27 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:28 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-a201abc0-1b5b-4729-b455-3ba88908b5dd req-4912bf78-4984-4d66-b622-eacb10c16af1 tempest-DeleteServersTestJSON-1801771082 None] Terminate volume connection completed successfully. Nov 01 12:21:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-a201abc0-1b5b-4729-b455-3ba88908b5dd req-4912bf78-4984-4d66-b622-eacb10c16af1 tempest-DeleteServersTestJSON-1801771082 None] Deleting attachment 2ea22d68-05c9-482a-96e6-32699259fb99. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:21:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9" returned: 0 in 0.573s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:28 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 1G Nov 01 12:21:28 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:29 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 1G" returned: 0 in 0.927s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:29 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 Nov 01 12:21:29 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:29 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4" returned: 0 in 0.671s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:29 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:21:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:29 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 Nov 01 12:21:29 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:30 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4" returned: 0 in 0.382s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Acquiring lock "cinder-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Lock "cinder-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:30 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.info Nov 01 12:21:30 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Acquiring lock "cinder-quobyte-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Lock "cinder-quobyte-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba9a761-ea3c-4ee7-906f-f02a6f733708]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:30 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f Nov 01 12:21:30 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:30 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.info" returned: 0 in 0.428s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:30 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:30 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.info Nov 01 12:21:30 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:30 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f" returned: 0 in 0.592s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:31 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f Nov 01 12:21:31 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:31 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.info" returned: 0 in 0.414s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.581s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:31 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1e8201a5-d368-4054-b101-63ea66167678 tempest-GroupSnapshotsV319Test-202244773 None] group_snapshot bc54330b-713e-40c4-9182-466fac344329: created successfully Nov 01 12:21:31 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f" returned: 0 in 0.369s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Lock "cinder-quobyte-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f" released by "delete_volume" :: held 1.078s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Created reservations ['9ef786ac-f7e0-498c-b85f-59b070c2ef6b', '89c8c796-15ac-4aac-ab0b-79ab5601e5b2', '10707256-5211-4ed7-8f08-bb240e01a369', '640e3b90-a80a-4faf-9d1a-f52f3b750b90'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:31 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:21:31 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:31 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.380s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:31 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:21:31 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Deleted volume successfully. Nov 01 12:21:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b9e92e2b-7079-4b44-ac96-3caf053b365c tempest-DeleteServersTestJSON-1801771082 None] Lock "cinder-d1d9a6b2-6aa9-44b5-997b-1eafbb13578f-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:33 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] group_snapshot bc54330b-713e-40c4-9182-466fac344329: deleting Nov 01 12:21:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] group_snapshot bc54330b-713e-40c4-9182-466fac344329: deleting {{(pid=86812) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 12:21:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Acquiring lock "cinder-quobyte-1d46c2e8-3c4d-46b6-9738-c967d68eece9" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Lock "cinder-quobyte-1d46c2e8-3c4d-46b6-9738-c967d68eece9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Acquiring lock "cinder-quobyte-f59ef9a6-05ef-4423-8c54-891a5fbff6e4" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Lock "cinder-quobyte-f59ef9a6-05ef-4423-8c54-891a5fbff6e4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Deleting offline snapshot f59ef9a6-05ef-4423-8c54-891a5fbff6e4 of volume 1d46c2e8-3c4d-46b6-9738-c967d68eece9 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:21:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] snapshot_file for this snap is: volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:21:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2215fba1-3a41-453a-a187-538c03b43b96]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:33 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 Nov 01 12:21:33 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:34 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4" returned: 0 in 0.750s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:21:34 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e955d6d8-7d5c-4764-b364-9de26401440f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:34 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 Nov 01 12:21:34 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:34 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9" returned: 0 in 0.639s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:34 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 Nov 01 12:21:34 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:35 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4" returned: 0 in 0.521s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:35 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4 Nov 01 12:21:35 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:35 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9.f59ef9a6-05ef-4423-8c54-891a5fbff6e4" returned: 0 in 0.430s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Lock "cinder-quobyte-f59ef9a6-05ef-4423-8c54-891a5fbff6e4" released by "_delete_snapshot" :: held 2.551s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Lock "cinder-quobyte-1d46c2e8-3c4d-46b6-9738-c967d68eece9" released by "delete_snapshot" :: held 2.594s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:35 devstack cinder-volume[86812]: WARNING cinder.quota [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-945621509 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-945621509, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:21:35 devstack cinder-volume[86812]: WARNING cinder.quota [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-945621509 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-945621509, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:21:36 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] Created reservations ['56a6943a-d968-4388-9c6d-a09e38d58614', '32dce66a-d26f-4d12-abb7-eb215fdffe38', '44b06a5a-5ee2-47e0-81a6-f855cd7532a4', 'e25bef58-c263-4859-90e3-aa017a91a3f6'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:21:36 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-622effba-933a-42aa-9bf9-f1816e16942a tempest-GroupSnapshotsV319Test-202244773 None] group_snapshot bc54330b-713e-40c4-9182-466fac344329: deleted successfully Nov 01 12:21:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:21:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:37 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:21:37 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:37 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.445s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:21:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Acquiring lock "cinder-quobyte-1d46c2e8-3c4d-46b6-9738-c967d68eece9" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Lock "cinder-quobyte-1d46c2e8-3c4d-46b6-9738-c967d68eece9" acquired by "delete_volume" :: waited 0.028s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[511238e5-b7da-4ade-9e83-ea8bdc03c979]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:37 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 Nov 01 12:21:37 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:38 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9" returned: 0 in 0.639s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:38 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9 Nov 01 12:21:38 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:38 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1d46c2e8-3c4d-46b6-9738-c967d68eece9" returned: 0 in 0.385s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Lock "cinder-quobyte-1d46c2e8-3c4d-46b6-9738-c967d68eece9" released by "delete_volume" :: held 1.096s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:38 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Created reservations ['fd30b3b5-fa63-4d1e-b709-37de5e7542b8'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:21:38 devstack cinder-volume[86812]: WARNING cinder.quota [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-945621509 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-945621509, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:21:38 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Created reservations ['9be77cb6-2e68-44ab-b64b-736cdfae9856', '92e36b94-7871-4a26-87f9-e876008bdc27', '1ac66a7a-cb1e-4393-9a6b-097b0ff7ecc0', 'd9ee6f19-1921-4410-b178-e4fd65167faf'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:21:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:39 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:21:39 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:39 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.315s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:39 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:21:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bacdfa15-2ed7-4009-99e1-cb2de12c199b tempest-GroupSnapshotsV319Test-202244773 None] Delete group completed successfully. Nov 01 12:21:49 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=35,cinder:UPDATE=32,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:21:49 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=39,cinder:SELECT=43,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Flow 'volume_create_manager' (96107447-cfb5-49c5-aafa-212c20bca7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e017344-a7c0-463e-9ab6-5d48a96c62c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e017344-a7c0-463e-9ab6-5d48a96c62c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2108463545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1ef04f-fc02-4483-b8e5-eabb525d0fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107cc8045e104290ba437828ece6a7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:54Z,use_quota=True,user_id='e8424d9be9e340ab83e44051b5bc728e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5317b695-d907-4410-8baf-84e2f793c9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5317b695-d907-4410-8baf-84e2f793c9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5d1383-969e-40b4-acaa-aafdb6634572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5d1383-969e-40b4-acaa-aafdb6634572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e1ef04f-fc02-4483-b8e5-eabb525d0fb3', 'volume_name': 'volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba24fb9-1c30-4900-9537-9edd54505731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba24fb9-1c30-4900-9537-9edd54505731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a66e222-be43-4960-b483-5d416ce55393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:54 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Volume 2e1ef04f-fc02-4483-b8e5-eabb525d0fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3', 'volume_size': 1} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2108463545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1ef04f-fc02-4483-b8e5-eabb525d0fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107cc8045e104290ba437828ece6a7cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:54Z,use_quota=True,user_id='e8424d9be9e340ab83e44051b5bc728e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Creating volume 2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:21:54 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:54 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 1073741824 Nov 01 12:21:54 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:54 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 1073741824" returned: 0 in 0.698s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:54 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 Nov 01 12:21:54 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:55 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3" returned: 0 in 0.337s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:21:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a66e222-be43-4960-b483-5d416ce55393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f09b80-6057-4918-bf08-fcdb194c1d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:55 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Volume volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 (2e1ef04f-fc02-4483-b8e5-eabb525d0fb3): created successfully Nov 01 12:21:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f09b80-6057-4918-bf08-fcdb194c1d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Flow 'volume_create_manager' (96107447-cfb5-49c5-aafa-212c20bca7ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:55 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e729801b-e87f-4de6-bbfa-9a73062c9b26 tempest-AttachVolumeShelveTestJSON-647903676 None] Created volume successfully. Nov 01 12:22:05 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:22:05 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:22:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-4921e45c-2f14-443e-a698-d112b7323594 req-37db0d60-b0ca-47fa-939b-f6e1fe09fdbd tempest-AttachVolumeShelveTestJSON-647903676 None] No connector for attachment 28448a87-aab3-478f-8d0a-1e9e18ca219a; skipping storage backend terminate_connection call. {{(pid=86812) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 01 12:22:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-4921e45c-2f14-443e-a698-d112b7323594 req-37db0d60-b0ca-47fa-939b-f6e1fe09fdbd tempest-AttachVolumeShelveTestJSON-647903676 None] Deleting attachment 28448a87-aab3-478f-8d0a-1e9e18ca219a. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:22:09 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:22:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Flow 'volume_create_manager' (eefa68f9-b099-40d8-89f5-2734b5be4ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddaecd5a-8596-490a-83aa-b15d4d35b75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddaecd5a-8596-490a-83aa-b15d4d35b75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1440339352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1077e83685455ea50c0a23ca77af09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:10Z,use_quota=True,user_id='3176ee29ba3e4c5a9672e9c8a9ae5833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc836d37-3e0f-4097-9ca0-754e7cd06976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc836d37-3e0f-4097-9ca0-754e7cd06976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba00ee46-fa62-4bd2-a5af-9cb542f9a33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba00ee46-fa62-4bd2-a5af-9cb542f9a33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b', 'volume_name': 'volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b85a285-7fdc-4d1e-9a33-f66c57f9bda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b85a285-7fdc-4d1e-9a33-f66c57f9bda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52284455-3698-4648-8ea3-d1cf7bcfe0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:10 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Volume 2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b', 'volume_size': 1} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1440339352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1077e83685455ea50c0a23ca77af09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:10Z,use_quota=True,user_id='3176ee29ba3e4c5a9672e9c8a9ae5833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Creating volume 2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:22:10 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:10 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b 1073741824 Nov 01 12:22:10 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:10 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b 1073741824" returned: 0 in 0.631s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:10 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b Nov 01 12:22:10 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:11 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b" returned: 0 in 0.330s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:22:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52284455-3698-4648-8ea3-d1cf7bcfe0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08032328-8639-4f67-a1cc-e83f25432087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:11 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Volume volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b (2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b): created successfully Nov 01 12:22:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08032328-8639-4f67-a1cc-e83f25432087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Flow 'volume_create_manager' (eefa68f9-b099-40d8-89f5-2734b5be4ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-918c01d4-6cdb-495a-b664-259b3732c43e tempest-ServerActionsTestOtherA-456736643 None] Created volume successfully. Nov 01 12:22:13 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:22:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Flow 'volume_create_manager' (e436b323-d793-451f-973c-c36ee5ad1385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5bb037-3b4e-443a-bfdf-461427ade5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a5bb037-3b4e-443a-bfdf-461427ade5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1626717464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f27f64-16bf-447f-9387-ec85666a1794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d751f4370745838c24d11f61776b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:14Z,use_quota=True,user_id='5a78dc18363347e3818b597309edef08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08040441-6799-4b4a-8d74-316993329f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08040441-6799-4b4a-8d74-316993329f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b19c375-6887-4e68-a8de-616abbb24f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b19c375-6887-4e68-a8de-616abbb24f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f27f64-16bf-447f-9387-ec85666a1794', 'volume_name': 'volume-02f27f64-16bf-447f-9387-ec85666a1794', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b8f9e5-ceed-4303-ae9d-6019e70f7734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b8f9e5-ceed-4303-ae9d-6019e70f7734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8c5838-5085-42a2-95ff-b1d396bd2a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:14 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Volume 02f27f64-16bf-447f-9387-ec85666a1794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f27f64-16bf-447f-9387-ec85666a1794', 'volume_size': 1} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1626717464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f27f64-16bf-447f-9387-ec85666a1794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d751f4370745838c24d11f61776b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:14Z,use_quota=True,user_id='5a78dc18363347e3818b597309edef08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Creating volume 02f27f64-16bf-447f-9387-ec85666a1794 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:22:14 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:14 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794 1073741824 Nov 01 12:22:14 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:14 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794 1073741824" returned: 0 in 0.595s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:14 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794 Nov 01 12:22:14 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:14 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794" returned: 0 in 0.325s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:22:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8c5838-5085-42a2-95ff-b1d396bd2a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f27f64-16bf-447f-9387-ec85666a1794', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38cd50a-7c0b-4675-af6d-ab8b565c3dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:15 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Volume volume-02f27f64-16bf-447f-9387-ec85666a1794 (02f27f64-16bf-447f-9387-ec85666a1794): created successfully Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38cd50a-7c0b-4675-af6d-ab8b565c3dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Flow 'volume_create_manager' (e436b323-d793-451f-973c-c36ee5ad1385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:15 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0971376d-98f3-4208-be95-9dfcdb1a4d74 tempest-TaggedAttachmentsTest-1310649280 None] Created volume successfully. Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Flow 'volume_create_manager' (8a1c744f-c7ff-4477-b58b-bf6d6e34acba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb950d1-3ee4-40ea-81fb-3e2ed83ba18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb950d1-3ee4-40ea-81fb-3e2ed83ba18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-370678739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e079627c-216b-41e0-9f43-b98897ba979b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26dbb284796f4ad686a3b3dbe5083bc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:16Z,use_quota=True,user_id='e99994ea054d488ea576db28e0a61f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef430188-7e8f-4fdb-9909-dcc6206a66a8),volume_type_id=ef430188-7e8f-4fdb-9909-dcc6206a66a8)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e31b2f-e1b4-4f35-8136-885003badf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e31b2f-e1b4-4f35-8136-885003badf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8150e41-420d-4c98-9916-1e285a1e801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8150e41-420d-4c98-9916-1e285a1e801e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e079627c-216b-41e0-9f43-b98897ba979b', 'volume_name': 'volume-e079627c-216b-41e0-9f43-b98897ba979b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f14352-6400-46ff-b028-ddb9d2635791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f14352-6400-46ff-b028-ddb9d2635791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551d3f26-5c65-4349-bc9d-37808a7fdd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:15 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Volume e079627c-216b-41e0-9f43-b98897ba979b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e079627c-216b-41e0-9f43-b98897ba979b', 'volume_size': 1} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-370678739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e079627c-216b-41e0-9f43-b98897ba979b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26dbb284796f4ad686a3b3dbe5083bc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:16Z,use_quota=True,user_id='e99994ea054d488ea576db28e0a61f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef430188-7e8f-4fdb-9909-dcc6206a66a8),volume_type_id=ef430188-7e8f-4fdb-9909-dcc6206a66a8)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Creating volume e079627c-216b-41e0-9f43-b98897ba979b {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:22:15 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:22:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:16 devstack sudo[89729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b 1073741824 Nov 01 12:22:16 devstack sudo[89729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:16 devstack sudo[89729]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b 1073741824" returned: 0 in 0.656s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:16 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b Nov 01 12:22:16 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:17 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b" returned: 0 in 0.407s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:22:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551d3f26-5c65-4349-bc9d-37808a7fdd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e079627c-216b-41e0-9f43-b98897ba979b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8685a28b-295f-44f8-8603-5e49395c938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:17 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Volume volume-e079627c-216b-41e0-9f43-b98897ba979b (e079627c-216b-41e0-9f43-b98897ba979b): created successfully Nov 01 12:22:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8685a28b-295f-44f8-8603-5e49395c938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Flow 'volume_create_manager' (8a1c744f-c7ff-4477-b58b-bf6d6e34acba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:17 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-118cc08f-ef12-4538-94ae-d9655765fcf4 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Created volume successfully. Nov 01 12:22:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-146f5dd1-b416-4bf5-b632-7b610c6d536f tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-146f5dd1-b416-4bf5-b632-7b610c6d536f tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-146f5dd1-b416-4bf5-b632-7b610c6d536f tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-146f5dd1-b416-4bf5-b632-7b610c6d536f tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-146f5dd1-b416-4bf5-b632-7b610c6d536f tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-146f5dd1-b416-4bf5-b632-7b610c6d536f tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:18 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:22:18 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:19 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-146f5dd1-b416-4bf5-b632-7b610c6d536f tempest-VolumeRetypeWithoutMigrationTest-963693415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.399s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:19 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-146f5dd1-b416-4bf5-b632-7b610c6d536f tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:19 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-146f5dd1-b416-4bf5-b632-7b610c6d536f tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Retype volume completed successfully. Nov 01 12:22:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Acquiring lock "cinder-e079627c-216b-41e0-9f43-b98897ba979b-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "cinder-e079627c-216b-41e0-9f43-b98897ba979b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Acquiring lock "cinder-quobyte-e079627c-216b-41e0-9f43-b98897ba979b" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "cinder-quobyte-e079627c-216b-41e0-9f43-b98897ba979b" acquired by "delete_volume" :: waited 0.028s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:20 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e88ec2-d7a9-4658-adec-f6cd444f5f0b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:20 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b Nov 01 12:22:20 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:21 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b" returned: 0 in 0.912s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:21 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b Nov 01 12:22:21 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:22 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e079627c-216b-41e0-9f43-b98897ba979b" returned: 0 in 0.709s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "cinder-quobyte-e079627c-216b-41e0-9f43-b98897ba979b" released by "delete_volume" :: held 1.735s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:22 devstack cinder-volume[86812]: WARNING cinder.quota [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:22:22 devstack cinder-volume[86812]: WARNING cinder.quota [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:22:22 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Created reservations ['fafbdd44-4eae-47ed-b6ea-3a4e97f7a6cd', '556fdf5b-33b7-44c0-8370-3baf0166356f', '1636c9e1-3d41-4e67-9b65-761ada3db0fe', '6f255368-14f5-4960-9aa3-3fadafc98aff'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:22 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:22:22 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:23 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.803s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:23 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Deleted volume successfully. Nov 01 12:22:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cdf3d601-3842-4e18-b3a4-d2b9559090c8 tempest-VolumeRetypeWithoutMigrationTest-963693415 None] Lock "cinder-e079627c-216b-41e0-9f43-b98897ba979b-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:32 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:22:33 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=19,cinder:UPDATE=19,cinder:DELETE=3,cinder:INSERT=4 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:22:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:22:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:37 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:22:37 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:37 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.529s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:22:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 8 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:22:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Flow 'volume_create_manager' (bbf10d7f-da30-436a-8ca5-5ce68bea07d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4df470c-727b-4982-89c8-1c7512460ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4df470c-727b-4982-89c8-1c7512460ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1141584342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97629cff-5a0b-4936-9ff0-433cfef01b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0df9362b5c477c9b16c869d8031c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:38Z,use_quota=True,user_id='72abac0ac6824e38956f69ce4fcb0ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1f1f2e-5651-408f-a989-0ca5b26ff1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1f1f2e-5651-408f-a989-0ca5b26ff1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2905f707-3209-4c5d-95e9-5c4a2890e772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2905f707-3209-4c5d-95e9-5c4a2890e772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97629cff-5a0b-4936-9ff0-433cfef01b9f', 'volume_name': 'volume-97629cff-5a0b-4936-9ff0-433cfef01b9f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee21a9fa-6445-4779-ab1e-a3e0aa58058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee21a9fa-6445-4779-ab1e-a3e0aa58058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7f91a5-acd1-4f49-8245-78a05cd83468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:38 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Volume 97629cff-5a0b-4936-9ff0-433cfef01b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97629cff-5a0b-4936-9ff0-433cfef01b9f', 'volume_size': 1} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1141584342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97629cff-5a0b-4936-9ff0-433cfef01b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb0df9362b5c477c9b16c869d8031c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:38Z,use_quota=True,user_id='72abac0ac6824e38956f69ce4fcb0ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Creating volume 97629cff-5a0b-4936-9ff0-433cfef01b9f {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:22:38 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:22:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:38 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f 1073741824 Nov 01 12:22:38 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:39 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f 1073741824" returned: 0 in 0.542s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:39 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f Nov 01 12:22:39 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:39 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f" returned: 0 in 0.363s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:22:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7f91a5-acd1-4f49-8245-78a05cd83468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97629cff-5a0b-4936-9ff0-433cfef01b9f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2901bbaf-47ce-4650-a7e7-bf990509a0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:39 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Volume volume-97629cff-5a0b-4936-9ff0-433cfef01b9f (97629cff-5a0b-4936-9ff0-433cfef01b9f): created successfully Nov 01 12:22:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2901bbaf-47ce-4650-a7e7-bf990509a0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Flow 'volume_create_manager' (bbf10d7f-da30-436a-8ca5-5ce68bea07d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0791a51d-5460-421c-8160-e4ae546ba967 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Created volume successfully. Nov 01 12:22:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Creating offline snapshot 4f686762-7f24-45a3-80a5-731eb37ad1fa of volume 97629cff-5a0b-4936-9ff0-433cfef01b9f {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:22:40 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ab133a-7656-46db-9d5f-d3536b6dd39b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:41 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f Nov 01 12:22:41 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:41 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f" returned: 0 in 0.383s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:41 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa 1G Nov 01 12:22:41 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:41 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa 1G" returned: 0 in 0.418s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97629cff-5a0b-4936-9ff0-433cfef01b9f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:41 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97629cff-5a0b-4936-9ff0-433cfef01b9f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa Nov 01 12:22:41 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:42 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97629cff-5a0b-4936-9ff0-433cfef01b9f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa" returned: 0 in 0.315s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:42 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa is being set with open permissions: ugo+rw Nov 01 12:22:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:42 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa Nov 01 12:22:42 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:42 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa" returned: 0 in 0.273s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:42 devstack sudo[90085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.info Nov 01 12:22:42 devstack sudo[90085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:42 devstack sudo[90085]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.info" returned: 0 in 0.298s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:42 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.info is being set with open permissions: ugo+rw Nov 01 12:22:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:42 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.info Nov 01 12:22:42 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:42 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.info" returned: 0 in 0.320s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.106s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e5d51fd6-188f-4197-9773-746aa81139bf tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Create snapshot completed successfully Nov 01 12:22:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Acquiring lock "cinder-4f686762-7f24-45a3-80a5-731eb37ad1fa-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "cinder-4f686762-7f24-45a3-80a5-731eb37ad1fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Acquiring lock "cinder-quobyte-97629cff-5a0b-4936-9ff0-433cfef01b9f" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "cinder-quobyte-97629cff-5a0b-4936-9ff0-433cfef01b9f" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Acquiring lock "cinder-quobyte-4f686762-7f24-45a3-80a5-731eb37ad1fa" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "cinder-quobyte-4f686762-7f24-45a3-80a5-731eb37ad1fa" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Deleting offline snapshot 4f686762-7f24-45a3-80a5-731eb37ad1fa of volume 97629cff-5a0b-4936-9ff0-433cfef01b9f {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:22:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] snapshot_file for this snap is: volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:22:45 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e0edbf-0f93-4b47-acf9-70da4ae46566]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:45 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa Nov 01 12:22:45 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:45 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa" returned: 0 in 0.448s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97629cff-5a0b-4936-9ff0-433cfef01b9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:22:45 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cc38e3-440f-45e9-8994-f4c2d667916c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:45 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f Nov 01 12:22:45 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:45 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f" returned: 0 in 0.473s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:46 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa Nov 01 12:22:46 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:46 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa" returned: 0 in 0.361s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:46 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa Nov 01 12:22:46 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:46 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f.4f686762-7f24-45a3-80a5-731eb37ad1fa" returned: 0 in 0.269s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "cinder-quobyte-4f686762-7f24-45a3-80a5-731eb37ad1fa" released by "_delete_snapshot" :: held 1.687s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "cinder-quobyte-97629cff-5a0b-4936-9ff0-433cfef01b9f" released by "delete_snapshot" :: held 1.723s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:46 devstack cinder-volume[86812]: WARNING cinder.quota [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:22:46 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Created reservations ['9be42740-230a-4a2a-aebe-9c5c755ec660', '3f783663-413d-4a49-b4e8-ff03e997e6e1', '4d90c83b-ccf5-4cc5-a262-56c900dbc014', '22ccb2a0-95a6-4cdd-8b28-796d451e67d5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Delete snapshot completed successfully. Nov 01 12:22:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705d46b7-f752-41d1-a4bf-17f9b3c35700 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "cinder-4f686762-7f24-45a3-80a5-731eb37ad1fa-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Acquiring lock "cinder-97629cff-5a0b-4936-9ff0-433cfef01b9f-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "cinder-97629cff-5a0b-4936-9ff0-433cfef01b9f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Acquiring lock "cinder-quobyte-97629cff-5a0b-4936-9ff0-433cfef01b9f" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "cinder-quobyte-97629cff-5a0b-4936-9ff0-433cfef01b9f" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1a1ddf-5b97-4a8e-8a6a-14f23e670254]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:47 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f Nov 01 12:22:47 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:47 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f" returned: 0 in 0.358s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:47 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f Nov 01 12:22:47 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:47 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-97629cff-5a0b-4936-9ff0-433cfef01b9f" returned: 0 in 0.247s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "cinder-quobyte-97629cff-5a0b-4936-9ff0-433cfef01b9f" released by "delete_volume" :: held 0.672s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:47 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Created reservations ['00516f90-cbbc-4814-80b3-e739f3c539f6', '56d21374-06e8-4113-a11d-5e3dd1f718d3', 'fa0bdbcc-b49a-464c-bbf2-8c67061c8149', '8159fe17-dd70-41e7-9261-5f11fda137a5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:48 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:22:48 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:48 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.284s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:48 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Deleted volume successfully. Nov 01 12:22:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d483e987-8314-4191-b662-997ae55047f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-977265529 None] Lock "cinder-97629cff-5a0b-4936-9ff0-433cfef01b9f-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-c6a995d8-9b10-4824-9b60-7aa02c5fb072 req-e85d205c-eb5c-4cbe-82b6-5d5c781b421a tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-c6a995d8-9b10-4824-9b60-7aa02c5fb072 req-e85d205c-eb5c-4cbe-82b6-5d5c781b421a tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-c6a995d8-9b10-4824-9b60-7aa02c5fb072 req-e85d205c-eb5c-4cbe-82b6-5d5c781b421a tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-c6a995d8-9b10-4824-9b60-7aa02c5fb072 req-e85d205c-eb5c-4cbe-82b6-5d5c781b421a tempest-ServerActionsTestOtherA-456736643 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acf5d4e7-57d9-43de-b845-9f7a1762731d', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:22:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-c6a995d8-9b10-4824-9b60-7aa02c5fb072 req-e85d205c-eb5c-4cbe-82b6-5d5c781b421a tempest-ServerActionsTestOtherA-456736643 None] attachment_update completed successfully. Nov 01 12:22:54 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-f2898537-752d-4e2c-99fa-56ea987cad55 req-cf586ce1-7454-44e8-a1f8-7db3d2702d95 tempest-ServerActionsTestOtherA-456736643 None] Terminate volume connection completed successfully. Nov 01 12:22:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-f2898537-752d-4e2c-99fa-56ea987cad55 req-cf586ce1-7454-44e8-a1f8-7db3d2702d95 tempest-ServerActionsTestOtherA-456736643 None] Deleting attachment acf5d4e7-57d9-43de-b845-9f7a1762731d. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:22:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-f2898537-752d-4e2c-99fa-56ea987cad55 req-fb09df7f-9e47-420f-badf-81bdd5fc1234 tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-f2898537-752d-4e2c-99fa-56ea987cad55 req-fb09df7f-9e47-420f-badf-81bdd5fc1234 tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-f2898537-752d-4e2c-99fa-56ea987cad55 req-fb09df7f-9e47-420f-badf-81bdd5fc1234 tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-f2898537-752d-4e2c-99fa-56ea987cad55 req-fb09df7f-9e47-420f-badf-81bdd5fc1234 tempest-ServerActionsTestOtherA-456736643 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c1867b11-c8c7-4707-ae94-fbf51d211a63', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:22:55 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-f2898537-752d-4e2c-99fa-56ea987cad55 req-fb09df7f-9e47-420f-badf-81bdd5fc1234 tempest-ServerActionsTestOtherA-456736643 None] attachment_update completed successfully. Nov 01 12:23:05 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=16,cinder:SELECT=32,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:23:05 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=29,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:23:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Acquiring lock "cinder-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Lock "cinder-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Acquiring lock "cinder-quobyte-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Lock "cinder-quobyte-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:11 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[098b27d6-1db2-4638-a942-8cd7175cdde9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:11 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 Nov 01 12:23:11 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:12 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3" returned: 0 in 0.362s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:12 devstack sudo[91267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3 Nov 01 12:23:12 devstack sudo[91267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:12 devstack sudo[91267]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3" returned: 0 in 0.254s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Lock "cinder-quobyte-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3" released by "delete_volume" :: held 0.667s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Created reservations ['7d88793b-60d4-499f-aad6-f9da25f448e5', '60f28f2c-2ead-4c45-bf57-b68aefcaac7b', 'b0aa0dfe-afea-463e-8507-23927729a264', 'f213b3a6-4f84-4d12-a2f4-1d35a33bb255'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:12 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:23:12 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:12 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.267s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:23:12 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Deleted volume successfully. Nov 01 12:23:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8e260fb8-77ae-42fc-89f7-4cc5bdc51310 tempest-AttachVolumeShelveTestJSON-647903676 None] Lock "cinder-2e1ef04f-fc02-4483-b8e5-eabb525d0fb3-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Flow 'volume_create_manager' (bb70f48d-37cb-4a23-a84b-4dd180f4bc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98de9974-a3d7-4ec2-8d5c-fb88c61f2f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98de9974-a3d7-4ec2-8d5c-fb88c61f2f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1892968633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a457c1-deb0-4f90-9fed-22aea90e280a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0b53f7f8fe42bfa5e1e4ec346a46ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:17Z,use_quota=True,user_id='7d729e4b3acb408491c4c1a4474e25ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5c8339-3ebf-4576-8e3f-945e3df56096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5c8339-3ebf-4576-8e3f-945e3df56096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be22e16-6926-402c-9713-19cce25c577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be22e16-6926-402c-9713-19cce25c577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a457c1-deb0-4f90-9fed-22aea90e280a', 'volume_name': 'volume-62a457c1-deb0-4f90-9fed-22aea90e280a', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0f50c9-66af-4c9a-bb38-65b7d12c67dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0f50c9-66af-4c9a-bb38-65b7d12c67dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258c26d0-f00c-4feb-a31b-eebb31bcdefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:16 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Volume 62a457c1-deb0-4f90-9fed-22aea90e280a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a457c1-deb0-4f90-9fed-22aea90e280a', 'volume_size': 1} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1892968633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a457c1-deb0-4f90-9fed-22aea90e280a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0b53f7f8fe42bfa5e1e4ec346a46ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:17Z,use_quota=True,user_id='7d729e4b3acb408491c4c1a4474e25ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Creating volume 62a457c1-deb0-4f90-9fed-22aea90e280a {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:23:16 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:23:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:16 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a 1073741824 Nov 01 12:23:16 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:17 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a 1073741824" returned: 0 in 0.600s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:17 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a Nov 01 12:23:17 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:17 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a" returned: 0 in 0.312s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:23:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258c26d0-f00c-4feb-a31b-eebb31bcdefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a457c1-deb0-4f90-9fed-22aea90e280a', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aed64fa-c6e1-46e8-a15f-7cbd19be9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:17 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Volume volume-62a457c1-deb0-4f90-9fed-22aea90e280a (62a457c1-deb0-4f90-9fed-22aea90e280a): created successfully Nov 01 12:23:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aed64fa-c6e1-46e8-a15f-7cbd19be9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Flow 'volume_create_manager' (bb70f48d-37cb-4a23-a84b-4dd180f4bc96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:17 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-60f86a5b-89ce-4a9c-bf3c-5fc0af98653a tempest-VolumesTransfersV357Test-452744064 None] Created volume successfully. Nov 01 12:23:20 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6cb401f2-9b89-4d9e-ad0f-cedb90c79d67 tempest-VolumesTransfersV357Test-711079619 None] Transfer volume completed successfully. Nov 01 12:23:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Acquiring lock "cinder-62a457c1-deb0-4f90-9fed-22aea90e280a-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Lock "cinder-62a457c1-deb0-4f90-9fed-22aea90e280a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Acquiring lock "cinder-quobyte-62a457c1-deb0-4f90-9fed-22aea90e280a" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Lock "cinder-quobyte-62a457c1-deb0-4f90-9fed-22aea90e280a" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e827c49-180b-41cd-bc2e-37b98ec65b75]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:22 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a Nov 01 12:23:22 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-901eb2f7-5518-4a14-833a-a219308c2b46 req-c18b2eb2-9276-43cd-a707-3704d6cfc2b7 tempest-TaggedAttachmentsTest-1310649280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-901eb2f7-5518-4a14-833a-a219308c2b46 req-c18b2eb2-9276-43cd-a707-3704d6cfc2b7 tempest-TaggedAttachmentsTest-1310649280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-901eb2f7-5518-4a14-833a-a219308c2b46 req-c18b2eb2-9276-43cd-a707-3704d6cfc2b7 tempest-TaggedAttachmentsTest-1310649280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-901eb2f7-5518-4a14-833a-a219308c2b46 req-c18b2eb2-9276-43cd-a707-3704d6cfc2b7 tempest-TaggedAttachmentsTest-1310649280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-02f27f64-16bf-447f-9387-ec85666a1794', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3144ef70-0133-437c-adae-6d85038d79dd', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:23:22 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Flow 'volume_create_manager' (43643ce4-f235-4589-bb69-e1d4d1df23d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab0cf7b-5666-40d3-98c0-41348bb4c5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-901eb2f7-5518-4a14-833a-a219308c2b46 req-c18b2eb2-9276-43cd-a707-3704d6cfc2b7 tempest-TaggedAttachmentsTest-1310649280 None] attachment_update completed successfully. Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a" returned: 0 in 0.598s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eab0cf7b-5666-40d3-98c0-41348bb4c5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-681171746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795bd878-d268-44fb-bb8b-f2ca36aa6317,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba95bfa72d14228ad3b6385c8a444a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:23Z,use_quota=True,user_id='9cc0b66708d945ada813fc0029a48e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:22 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b02c41c-30d0-4e88-ba5f-12a82dbd9c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:22 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b02c41c-30d0-4e88-ba5f-12a82dbd9c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336cafb7-3bea-4295-ad8d-40f497bc4cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336cafb7-3bea-4295-ad8d-40f497bc4cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795bd878-d268-44fb-bb8b-f2ca36aa6317', 'volume_name': 'volume-795bd878-d268-44fb-bb8b-f2ca36aa6317', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fd67e7-165f-47ea-ae3d-d2674eb7f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fd67e7-165f-47ea-ae3d-d2674eb7f43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029733d6-c601-43cb-b6d2-67fc8467e991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:22 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Volume 795bd878-d268-44fb-bb8b-f2ca36aa6317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795bd878-d268-44fb-bb8b-f2ca36aa6317', 'volume_size': 1} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-681171746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795bd878-d268-44fb-bb8b-f2ca36aa6317,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2ba95bfa72d14228ad3b6385c8a444a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:23Z,use_quota=True,user_id='9cc0b66708d945ada813fc0029a48e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Creating volume 795bd878-d268-44fb-bb8b-f2ca36aa6317 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:23:22 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:23:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:22 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317 1073741824 Nov 01 12:23:22 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:23 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62a457c1-deb0-4f90-9fed-22aea90e280a" returned: 0 in 0.397s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Lock "cinder-quobyte-62a457c1-deb0-4f90-9fed-22aea90e280a" released by "delete_volume" :: held 1.073s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Created reservations ['5dcb6b39-e969-4e9c-acb3-26610b439889', 'fadcc9c7-493c-4c05-a2a8-f6db48eaba7e', '0eb4965b-0e3d-4a87-b1b5-422f9947216f', 'a4bab6ef-78c8-4be3-a5ca-54446e44a99d'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:23 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:23:23 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:23 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317 1073741824" returned: 0 in 0.714s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:23 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317 Nov 01 12:23:23 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:23 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.313s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:23:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Deleted volume successfully. Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efe496c4-ec4a-4af4-8a59-9baefd4ebd00 tempest-VolumesTransfersV357Test-626749586 None] Lock "cinder-62a457c1-deb0-4f90-9fed-22aea90e280a-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-5fc3328a-b6b6-4b94-a9e9-ad4d289fd8e9 req-47d019a3-419a-42e8-9675-098f9f709f8e tempest-ServerActionsTestOtherA-456736643 None] Terminate volume connection completed successfully. Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-5fc3328a-b6b6-4b94-a9e9-ad4d289fd8e9 req-47d019a3-419a-42e8-9675-098f9f709f8e tempest-ServerActionsTestOtherA-456736643 None] Deleting attachment c1867b11-c8c7-4707-ae94-fbf51d211a63. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:23:23 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029733d6-c601-43cb-b6d2-67fc8467e991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795bd878-d268-44fb-bb8b-f2ca36aa6317', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cf0b21-6f8a-4f70-bfc5-6b90d57d6c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:23 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Volume volume-795bd878-d268-44fb-bb8b-f2ca36aa6317 (795bd878-d268-44fb-bb8b-f2ca36aa6317): created successfully Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19cf0b21-6f8a-4f70-bfc5-6b90d57d6c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Flow 'volume_create_manager' (43643ce4-f235-4589-bb69-e1d4d1df23d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-99b8e779-d824-4ce4-a635-337ce8f61781 req-27d9e96a-b48c-4dde-9c1b-2f0fe3434684 tempest-VolumesGetTestJSON-2022761343 None] Created volume successfully. Nov 01 12:23:24 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Flow 'volume_create_manager' (0b2f75f2-10b3-46c8-ac95-afdea532f4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f30f26-4bd2-4455-94fb-61b5bd7275bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f30f26-4bd2-4455-94fb-61b5bd7275bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-458469714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1467cb-4d68-4fd1-95f9-4fbd79198cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0b53f7f8fe42bfa5e1e4ec346a46ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:25Z,use_quota=True,user_id='7d729e4b3acb408491c4c1a4474e25ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c058847-9e4b-427e-8260-f6e0bf1e161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c058847-9e4b-427e-8260-f6e0bf1e161d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d80725-1ab3-45c5-9bf4-5a6f14326f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d80725-1ab3-45c5-9bf4-5a6f14326f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1467cb-4d68-4fd1-95f9-4fbd79198cf3', 'volume_name': 'volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18ac5d7-d645-455b-a599-6cb3a0e4c27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18ac5d7-d645-455b-a599-6cb3a0e4c27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280d258e-a903-4a92-b04a-0e6fb7c12d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Volume 6b1467cb-4d68-4fd1-95f9-4fbd79198cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3', 'volume_size': 1} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-458469714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1467cb-4d68-4fd1-95f9-4fbd79198cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b0b53f7f8fe42bfa5e1e4ec346a46ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:25Z,use_quota=True,user_id='7d729e4b3acb408491c4c1a4474e25ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Creating volume 6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:23:25 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:25 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 1073741824 Nov 01 12:23:25 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Acquiring lock "cinder-795bd878-d268-44fb-bb8b-f2ca36aa6317-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Lock "cinder-795bd878-d268-44fb-bb8b-f2ca36aa6317-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Acquiring lock "cinder-quobyte-795bd878-d268-44fb-bb8b-f2ca36aa6317" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Lock "cinder-quobyte-795bd878-d268-44fb-bb8b-f2ca36aa6317" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fc968d-0a78-46db-b9d4-80cc5910045c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:25 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317 Nov 01 12:23:25 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-a2c28c31-89d9-488f-9949-4a64eb9a179f req-de2c659b-b999-4c7c-a93d-88e6ece97e1b tempest-TaggedAttachmentsTest-1310649280 None] Terminate volume connection completed successfully. Nov 01 12:23:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-a2c28c31-89d9-488f-9949-4a64eb9a179f req-de2c659b-b999-4c7c-a93d-88e6ece97e1b tempest-TaggedAttachmentsTest-1310649280 None] Deleting attachment 3144ef70-0133-437c-adae-6d85038d79dd. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:23:26 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 1073741824" returned: 0 in 0.869s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:26 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 Nov 01 12:23:26 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:26 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317" returned: 0 in 0.616s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:26 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317 Nov 01 12:23:26 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:26 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3" returned: 0 in 0.428s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280d258e-a903-4a92-b04a-0e6fb7c12d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7fae89-7a77-4b38-b232-b2eb208bfbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:26 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Volume volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 (6b1467cb-4d68-4fd1-95f9-4fbd79198cf3): created successfully Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7fae89-7a77-4b38-b232-b2eb208bfbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Flow 'volume_create_manager' (0b2f75f2-10b3-46c8-ac95-afdea532f4b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:26 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-097b9309-31c0-4b8f-9b62-96ddedc981d5 tempest-VolumesTransfersV357Test-452744064 None] Created volume successfully. Nov 01 12:23:26 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-795bd878-d268-44fb-bb8b-f2ca36aa6317" returned: 0 in 0.390s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Lock "cinder-quobyte-795bd878-d268-44fb-bb8b-f2ca36aa6317" released by "delete_volume" :: held 1.065s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG cinder.quota [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Created reservations ['fc1a5010-aad7-4248-86c9-da6ca845528f', 'b5a5767e-5389-4ddd-83d8-f5d4f7ed8f06', '73ab5138-5c56-4b84-bc87-8f3ca506df7e', '35c90009-2e9c-4ca5-93f8-41809bca4631'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:26 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:23:26 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:27 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.591s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:27 devstack cinder-volume[86812]: DEBUG cinder.manager [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:23:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Deleted volume successfully. Nov 01 12:23:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8bae549e-b71e-46a7-bf25-bcdb83cb4a90 req-4cf86012-69f7-4ac0-ba67-cdf02c5c111b tempest-VolumesGetTestJSON-2022761343 None] Lock "cinder-795bd878-d268-44fb-bb8b-f2ca36aa6317-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Acquiring lock "cinder-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Lock "cinder-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Acquiring lock "cinder-quobyte-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Lock "cinder-quobyte-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:27 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1d8a4e-b8fd-4f1f-a85b-c3aa85b76691]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:28 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 Nov 01 12:23:28 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:28 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3" returned: 0 in 0.705s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:28 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3 Nov 01 12:23:28 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:29 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3" returned: 0 in 0.436s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Lock "cinder-quobyte-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3" released by "delete_volume" :: held 1.206s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Created reservations ['f8bd94a4-7f03-4091-a2a1-446391956e1c', '3a451758-ee0d-4950-80f5-66295fc4e265', '55eda3a3-3658-4330-b711-f1120fff3ee8', '58d8509a-73c6-4ba4-a199-766049ca1261'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:29 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:23:29 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:29 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.346s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:23:29 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Deleted volume successfully. Nov 01 12:23:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-128226e4-a114-41c2-a724-224b376e002e tempest-VolumesTransfersV357Test-626749586 None] Lock "cinder-6b1467cb-4d68-4fd1-95f9-4fbd79198cf3-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:33 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:23:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Flow 'volume_create_manager' (9229b79d-f6a0-4386-9ba8-508a448cd202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaceef0-999a-4b6d-adcf-82211734bfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaceef0-999a-4b6d-adcf-82211734bfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1384891066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce93605-8a36-45a5-92d2-7e92d3720652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1077e83685455ea50c0a23ca77af09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:34Z,use_quota=True,user_id='3176ee29ba3e4c5a9672e9c8a9ae5833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0586d2-27fa-4ea3-a86c-d740069bc90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a0586d2-27fa-4ea3-a86c-d740069bc90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d43f8d8-6647-449d-8951-611eb288f0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:33 devstack cinder-volume[86812]: DEBUG cinder.image.glance [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Creating Keystone auth plugin from conf {{(pid=86812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:23:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d43f8d8-6647-449d-8951-611eb288f0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ce93605-8a36-45a5-92d2-7e92d3720652', 'volume_name': 'volume-6ce93605-8a36-45a5-92d2-7e92d3720652', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f583b235-eca0-43dd-ba7b-c7e21fa27338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f583b235-eca0-43dd-ba7b-c7e21fa27338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa712d63-5b19-46da-b616-41f30bd58b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:34 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Volume 6ce93605-8a36-45a5-92d2-7e92d3720652: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ce93605-8a36-45a5-92d2-7e92d3720652', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 12:23:34 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Trying to clone 6ce93605-8a36-45a5-92d2-7e92d3720652 from image c5fdc172-8826-4b34-a68d-2114e120626b at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]). {{(pid=86812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:23:35 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:23:35 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Image download 20.69 MB at 20.69 MB/s Nov 01 12:23:35 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae690cac-d01f-49e6-8eab-75a48ebb8955]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:35 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD Nov 01 12:23:35 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:35 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:35 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Temporary image c5fdc172-8826-4b34-a68d-2114e120626b is fetched for user 3176ee29ba3e4c5a9672e9c8a9ae5833. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:23:35 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6237008b-441c-45c0-907c-2dce1f861776]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:35 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD Nov 01 12:23:35 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:36 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1384891066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce93605-8a36-45a5-92d2-7e92d3720652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa1077e83685455ea50c0a23ca77af09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:34Z,use_quota=True,user_id='3176ee29ba3e4c5a9672e9c8a9ae5833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Creating volume 6ce93605-8a36-45a5-92d2-7e92d3720652 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:23:36 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:36 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 1073741824 Nov 01 12:23:36 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:36 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 1073741824" returned: 0 in 0.560s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:36 devstack sudo[91563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 Nov 01 12:23:36 devstack sudo[91563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:37 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:23:37 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:37 devstack sudo[91563]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652" returned: 0 in 0.394s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Attempting download of c5fdc172-8826-4b34-a68d-2114e120626b ((None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}])) to volume 6ce93605-8a36-45a5-92d2-7e92d3720652. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee1c423-364d-4387-9009-2b48d5931c67]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_b9h5rn28 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:37 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.370s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Acquiring lock "cinder-02f27f64-16bf-447f-9387-ec85666a1794-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:37 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_b9h5rn28 Nov 01 12:23:37 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Lock "cinder-02f27f64-16bf-447f-9387-ec85666a1794-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Acquiring lock "cinder-quobyte-02f27f64-16bf-447f-9387-ec85666a1794" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Lock "cinder-quobyte-02f27f64-16bf-447f-9387-ec85666a1794" acquired by "delete_volume" :: waited 0.026s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb0b10b-727b-4c62-8bf2-9879d2c8bf9e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:37 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794 Nov 01 12:23:37 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:37 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_b9h5rn28" returned: 0 in 0.523s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_b9h5rn28 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:37 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_b9h5rn28 Nov 01 12:23:37 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:38 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794" returned: 0 in 0.450s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:38 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794 Nov 01 12:23:38 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:38 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_b9h5rn28" returned: 1 in 0.405s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_b9h5rn28' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd05c0a-e2a3-457c-9510-91f11089b1c5]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:38 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD Nov 01 12:23:38 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:38 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02f27f64-16bf-447f-9387-ec85666a1794" returned: 0 in 0.380s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Lock "cinder-quobyte-02f27f64-16bf-447f-9387-ec85666a1794" released by "delete_volume" :: held 0.896s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Created reservations ['9e3e9377-daa6-4daf-9701-afa4ef78ba17', '7e1a259c-1596-4ef2-bcb3-7290ab29e2ec', 'f8e02f13-735d-4524-9a79-1a2fd72e33f1', 'fceb45c7-14ca-4c91-a52d-c2a819a7a337'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:38 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] c5fdc172-8826-4b34-a68d-2114e120626b was qcow2, converting to qcow2 {{(pid=86812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:23:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:38 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:23:38 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:38 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 Nov 01 12:23:38 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:39 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.298s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:23:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Deleted volume successfully. Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eea80f5-71b9-43e6-85c7-756a7e018810 tempest-TaggedAttachmentsTest-1310649280 None] Lock "cinder-02f27f64-16bf-447f-9387-ec85666a1794-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Flow 'volume_create_manager' (4306eaa4-65d6-4439-88b7-204661f552ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8436d61-d354-4a6d-aec7-d6e4a419f20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8436d61-d354-4a6d-aec7-d6e4a419f20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1761465542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c809644-576a-44e6-a8e9-09e14108e739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84e5b38e5c249eb9e128ea6dbb11b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:40Z,use_quota=True,user_id='28791bfef41947139b02c4b7eedfeeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d44007-5a12-409c-aa02-f4e3a843699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d44007-5a12-409c-aa02-f4e3a843699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515f0fc1-331a-45cc-ac9b-6258821c022a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (515f0fc1-331a-45cc-ac9b-6258821c022a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c809644-576a-44e6-a8e9-09e14108e739', 'volume_name': 'volume-2c809644-576a-44e6-a8e9-09e14108e739', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99820039-05a5-4bc3-9195-8383e1c16ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99820039-05a5-4bc3-9195-8383e1c16ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070cc92d-3456-498d-868e-ba024f34ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:39 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Volume 2c809644-576a-44e6-a8e9-09e14108e739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c809644-576a-44e6-a8e9-09e14108e739', 'volume_size': 1} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1761465542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c809644-576a-44e6-a8e9-09e14108e739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84e5b38e5c249eb9e128ea6dbb11b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:40Z,use_quota=True,user_id='28791bfef41947139b02c4b7eedfeeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Creating volume 2c809644-576a-44e6-a8e9-09e14108e739 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:23:39 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:23:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:39 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 1073741824 Nov 01 12:23:39 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:40 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 1073741824" returned: 0 in 0.590s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:40 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 Nov 01 12:23:40 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:40 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739" returned: 0 in 0.343s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:23:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070cc92d-3456-498d-868e-ba024f34ecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c809644-576a-44e6-a8e9-09e14108e739', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714be026-0826-4adf-8b03-5c2161528064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:40 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Volume volume-2c809644-576a-44e6-a8e9-09e14108e739 (2c809644-576a-44e6-a8e9-09e14108e739): created successfully Nov 01 12:23:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714be026-0826-4adf-8b03-5c2161528064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Flow 'volume_create_manager' (4306eaa4-65d6-4439-88b7-204661f552ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:40 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-278564c4-c154-4373-aa88-2049087e07da tempest-VolumesCloneTest-1006123683 None] Created volume successfully. Nov 01 12:23:41 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652" returned: 0 in 2.456s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zhgphbyydevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:23:41 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Converted 112.00 MB image at 45.58 MB/s Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:41 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 1G Nov 01 12:23:41 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:41 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 1G" returned: 0 in 0.405s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Downloaded image c5fdc172-8826-4b34-a68d-2114e120626b ((None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}])) to volume 6ce93605-8a36-45a5-92d2-7e92d3720652 successfully. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Temporary image c5fdc172-8826-4b34-a68d-2114e120626b for user 3176ee29ba3e4c5a9672e9c8a9ae5833 is deleted. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Marking volume 6ce93605-8a36-45a5-92d2-7e92d3720652 as bootable. {{(pid=86812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Copying metadata from image c5fdc172-8826-4b34-a68d-2114e120626b to 6ce93605-8a36-45a5-92d2-7e92d3720652. {{(pid=86812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Creating volume glance metadata for volume 6ce93605-8a36-45a5-92d2-7e92d3720652 backed by image c5fdc172-8826-4b34-a68d-2114e120626b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa712d63-5b19-46da-b616-41f30bd58b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce93605-8a36-45a5-92d2-7e92d3720652', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f452d4-7408-4567-a641-36e84bc302ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:41 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Volume volume-6ce93605-8a36-45a5-92d2-7e92d3720652 (6ce93605-8a36-45a5-92d2-7e92d3720652): created successfully Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f452d4-7408-4567-a641-36e84bc302ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Flow 'volume_create_manager' (9229b79d-f6a0-4386-9ba8-508a448cd202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:41 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-338404e4-f5c5-437e-bb2d-300e8dd5e5ba tempest-ServerActionsTestOtherA-456736643 None] Created volume successfully. Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Flow 'volume_create_manager' (296f2ad6-6b66-44e4-a3dd-701aee6e1b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8c4c28-f0f6-4fb4-a52b-9c1d7d207658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8c4c28-f0f6-4fb4-a52b-9c1d7d207658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-93484197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62080752-a3fd-481c-a112-c888455d5cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d84e5b38e5c249eb9e128ea6dbb11b6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2c809644-576a-44e6-a8e9-09e14108e739,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:42Z,use_quota=True,user_id='28791bfef41947139b02c4b7eedfeeaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfba8f88-d2de-4bb4-bea9-1f6ceb3fddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfba8f88-d2de-4bb4-bea9-1f6ceb3fddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b3215f-a7c2-4b1b-b47e-666e72173643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-923db939-3f66-47e6-94a9-e0dddfd65f71 tempest-GroupsTest-1555572700 None] Group tempest-Group1-1717518599: creating Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b3215f-a7c2-4b1b-b47e-666e72173643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '62080752-a3fd-481c-a112-c888455d5cf0', 'volume_name': 'volume-62080752-a3fd-481c-a112-c888455d5cf0', 'volume_size': 2, 'source_volid': '2c809644-576a-44e6-a8e9-09e14108e739', 'source_volstatus': 'available'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f183b44-be4c-4054-976b-5e78aacea15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f183b44-be4c-4054-976b-5e78aacea15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55aeebd-4ab1-4633-8172-5c74cce4ed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:42 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Volume 62080752-a3fd-481c-a112-c888455d5cf0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-62080752-a3fd-481c-a112-c888455d5cf0', 'volume_size': 2, 'source_volid': '2c809644-576a-44e6-a8e9-09e14108e739', 'source_volstatus': 'available'} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:42 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Cloning volume 2c809644-576a-44e6-a8e9-09e14108e739 to volume 62080752-a3fd-481c-a112-c888455d5cf0 Nov 01 12:23:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-923db939-3f66-47e6-94a9-e0dddfd65f71 tempest-GroupsTest-1555572700 None] Group tempest-Group1-1717518599: created successfully Nov 01 12:23:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-923db939-3f66-47e6-94a9-e0dddfd65f71 tempest-GroupsTest-1555572700 None] Create group completed successfully. Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Creating offline snapshot 6e401948-a7b4-464a-a8ca-7d56e135c995 of volume 2c809644-576a-44e6-a8e9-09e14108e739 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[051f17c1-c5bd-4552-b462-b730bdb58b96]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:42 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 Nov 01 12:23:42 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:43 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739" returned: 0 in 0.431s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:43 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 1G Nov 01 12:23:43 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:43 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 1G" returned: 0 in 0.531s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c809644-576a-44e6-a8e9-09e14108e739 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:43 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c809644-576a-44e6-a8e9-09e14108e739 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 Nov 01 12:23:43 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b0a6716a-9dd7-4c2c-ba9e-8f5caadca807 tempest-GroupsTest-1555572700 None] Group tempest-Group2-569633764: creating Nov 01 12:23:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b0a6716a-9dd7-4c2c-ba9e-8f5caadca807 tempest-GroupsTest-1555572700 None] Group tempest-Group2-569633764: created successfully Nov 01 12:23:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b0a6716a-9dd7-4c2c-ba9e-8f5caadca807 tempest-GroupsTest-1555572700 None] Create group completed successfully. Nov 01 12:23:44 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c809644-576a-44e6-a8e9-09e14108e739 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995" returned: 0 in 0.498s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:44 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 is being set with open permissions: ugo+rw Nov 01 12:23:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:44 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 Nov 01 12:23:44 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:44 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995" returned: 0 in 0.332s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:44 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.info Nov 01 12:23:44 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:44 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.info" returned: 0 in 0.282s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:44 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.info is being set with open permissions: ugo+rw Nov 01 12:23:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:44 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.info Nov 01 12:23:44 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:45 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.info" returned: 0 in 0.416s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Acquiring lock "cinder-quobyte-62080752-a3fd-481c-a112-c888455d5cf0" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Lock "cinder-quobyte-62080752-a3fd-481c-a112-c888455d5cf0" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] snapshot: 6e401948-a7b4-464a-a8ca-7d56e135c995, volume: 62080752-a3fd-481c-a112-c888455d5cf0, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dfa1f7-01db-4383-abce-a39e3d474993]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:45 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 Nov 01 12:23:45 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Flow 'volume_create_manager' (18d15b76-43a1-4678-ace8-1c329719d4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda030ca-9783-4b2a-b22e-d819dabd8034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda030ca-9783-4b2a-b22e-d819dabd8034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-141825476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9521b221-45e7-4f74-91fd-20c3904c4534,host='devstack@QuobyteHD#QuobyteHD',id=81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9e74c744eb4c77b53d846b9790f28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:46Z,use_quota=True,user_id='e7b229e3031d40ee81eaf3c84692e01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4de57164-7873-4d7f-87ec-7b6ad99f86d1),volume_type_id=4de57164-7873-4d7f-87ec-7b6ad99f86d1)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d3d28f-6b6e-4a31-9df9-af3bf0e37069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d3d28f-6b6e-4a31-9df9-af3bf0e37069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b3f425-0267-4f69-90e6-2717f267e79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b3f425-0267-4f69-90e6-2717f267e79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f', 'volume_name': 'volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b806c3-1ba4-43aa-9238-aad344b2e135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b806c3-1ba4-43aa-9238-aad344b2e135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94aac38-2fa9-4258-8e4f-1fe0575bf010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:46 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Volume 81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f', 'volume_size': 1} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-450d0cff-1e63-4e0f-95a6-29053821a4c8 req-60fe9996-7306-4a02-85f5-62ce705d325d tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:46 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995" returned: 0 in 0.671s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c809644-576a-44e6-a8e9-09e14108e739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb51e26a-763c-449e-ace1-09da79d5dd68]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:46 devstack sudo[91675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 Nov 01 12:23:46 devstack sudo[91675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:46 devstack sudo[91675]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739" returned: 0 in 0.547s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:23:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:46 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 Nov 01 12:23:46 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:54 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0" returned: 0 in 8.035s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:54 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:23:54 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Converted 1024.00 MB image at 127.38 MB/s Nov 01 12:23:54 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 is being set with open permissions: ugo+rw Nov 01 12:23:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:54 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 Nov 01 12:23:54 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:54 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0" returned: 0 in 0.319s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Lock "cinder-quobyte-62080752-a3fd-481c-a112-c888455d5cf0" released by "_copy_volume_from_snapshot" :: held 9.696s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Acquiring lock "cinder-quobyte-6e401948-a7b4-464a-a8ca-7d56e135c995" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Lock "cinder-quobyte-6e401948-a7b4-464a-a8ca-7d56e135c995" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Deleting offline snapshot 6e401948-a7b4-464a-a8ca-7d56e135c995 of volume 2c809644-576a-44e6-a8e9-09e14108e739 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:23:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] snapshot_file for this snap is: volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:23:55 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41c831e-4b11-44fe-9c26-a2cb3907a3ea]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:55 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 Nov 01 12:23:55 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:55 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995" returned: 0 in 0.374s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c809644-576a-44e6-a8e9-09e14108e739(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:23:55 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6319bd8-8b62-4b23-93f1-9b05316ff473]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:55 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 Nov 01 12:23:55 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=61,cinder:INSERT=20,cinder:UPDATE=69,cinder:DELETE=3 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:23:56 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739" returned: 0 in 0.574s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:56 devstack sudo[91723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 Nov 01 12:23:56 devstack sudo[91723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:56 devstack sudo[91723]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995" returned: 0 in 0.386s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:56 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995 Nov 01 12:23:56 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:56 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739.6e401948-a7b4-464a-a8ca-7d56e135c995" returned: 0 in 0.292s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Lock "cinder-quobyte-6e401948-a7b4-464a-a8ca-7d56e135c995" released by "_delete_snapshot" :: held 1.739s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.184s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.792s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9521b221-45e7-4f74-91fd-20c3904c4534,created_at=2026-11-01T11:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-141825476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9521b221-45e7-4f74-91fd-20c3904c4534,host='devstack@QuobyteHD#QuobyteHD',id=81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9e74c744eb4c77b53d846b9790f28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:46Z,use_quota=True,user_id='e7b229e3031d40ee81eaf3c84692e01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4de57164-7873-4d7f-87ec-7b6ad99f86d1),volume_type_id=4de57164-7873-4d7f-87ec-7b6ad99f86d1)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Creating volume 81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:23:56 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:56 devstack sudo[91768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f 1073741824 Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55aeebd-4ab1-4633-8172-5c74cce4ed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62080752-a3fd-481c-a112-c888455d5cf0', 'volume_size': 2, 'source_volid': '2c809644-576a-44e6-a8e9-09e14108e739', 'source_volstatus': 'available'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:56 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48b1067-9a7c-43fc-8f7b-aa0313890391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:56 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Volume volume-62080752-a3fd-481c-a112-c888455d5cf0 (62080752-a3fd-481c-a112-c888455d5cf0): created successfully Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48b1067-9a7c-43fc-8f7b-aa0313890391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Flow 'volume_create_manager' (296f2ad6-6b66-44e4-a3dd-701aee6e1b83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4153f743-69a3-4e20-905d-819f9172d79b tempest-VolumesCloneTest-1006123683 None] Created volume successfully. Nov 01 12:23:57 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f 1073741824" returned: 0 in 0.489s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:57 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f Nov 01 12:23:57 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Flow 'volume_create_manager' (d2f78785-aad1-42a0-8be9-29bd957add1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eabc9c6-d97e-4aca-90c1-4912539758ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eabc9c6-d97e-4aca-90c1-4912539758ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1625314759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c48ddd-37ee-43dd-ad55-deab36ca6cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66fe819227414098d445abba0cbd99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:57Z,use_quota=True,user_id='cd294da4476d4c20a5821adfe59d046c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca01232e-a619-4da5-84a5-dbe2e2c15069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca01232e-a619-4da5-84a5-dbe2e2c15069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f73a49b-85f4-4a41-98ee-9caaeb5512c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f73a49b-85f4-4a41-98ee-9caaeb5512c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c48ddd-37ee-43dd-ad55-deab36ca6cac', 'volume_name': 'volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e325abd3-3ce1-4f1d-9d11-fa1092ebe07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e325abd3-3ce1-4f1d-9d11-fa1092ebe07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e66803-801e-4138-a593-fcefcc85252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:57 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Volume e2c48ddd-37ee-43dd-ad55-deab36ca6cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac', 'volume_size': 1} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:57 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f" returned: 0 in 0.320s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-450d0cff-1e63-4e0f-95a6-29053821a4c8 req-60fe9996-7306-4a02-85f5-62ce705d325d tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.640s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-450d0cff-1e63-4e0f-95a6-29053821a4c8 req-60fe9996-7306-4a02-85f5-62ce705d325d tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.105s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1625314759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c48ddd-37ee-43dd-ad55-deab36ca6cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f66fe819227414098d445abba0cbd99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:57Z,use_quota=True,user_id='cd294da4476d4c20a5821adfe59d046c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Creating volume e2c48ddd-37ee-43dd-ad55-deab36ca6cac {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:23:57 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94aac38-2fa9-4258-8e4f-1fe0575bf010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee9464e-2930-4019-9ef7-ef539605df30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:57 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac 1073741824 Nov 01 12:23:57 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:57 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Volume volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f (81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f): created successfully Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee9464e-2930-4019-9ef7-ef539605df30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Flow 'volume_create_manager' (18d15b76-43a1-4678-ace8-1c329719d4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:57 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9aa82c5f-2a84-461a-a59b-1bb9739f2077 tempest-GroupsTest-1555572700 None] Created volume successfully. Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-450d0cff-1e63-4e0f-95a6-29053821a4c8 req-60fe9996-7306-4a02-85f5-62ce705d325d tempest-ServerActionsTestOtherA-456736643 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-6ce93605-8a36-45a5-92d2-7e92d3720652', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe3ed3f9-d178-4bfc-b704-3c8aefca06c0', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:23:57 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-450d0cff-1e63-4e0f-95a6-29053821a4c8 req-60fe9996-7306-4a02-85f5-62ce705d325d tempest-ServerActionsTestOtherA-456736643 None] attachment_update completed successfully. Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Acquiring lock "cinder-62080752-a3fd-481c-a112-c888455d5cf0-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Lock "cinder-62080752-a3fd-481c-a112-c888455d5cf0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Acquiring lock "cinder-quobyte-62080752-a3fd-481c-a112-c888455d5cf0" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Lock "cinder-quobyte-62080752-a3fd-481c-a112-c888455d5cf0" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[76246fe2-41f9-4c77-9085-05d6c56331f0]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:58 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 Nov 01 12:23:58 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:58 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac 1073741824" returned: 0 in 0.547s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:58 devstack sudo[91810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac Nov 01 12:23:58 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:58 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0" returned: 0 in 0.489s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:58 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0 Nov 01 12:23:58 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:58 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" returned: 0 in 0.571s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e66803-801e-4138-a593-fcefcc85252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3079759-35d3-4e29-8f32-754d13d57c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:58 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Volume volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac (e2c48ddd-37ee-43dd-ad55-deab36ca6cac): created successfully Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3079759-35d3-4e29-8f32-754d13d57c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Flow 'volume_create_manager' (d2f78785-aad1-42a0-8be9-29bd957add1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:58 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-09f42ef0-51fb-4ed9-a26c-f6d6da42c789 req-b2d18121-de61-477a-bc7a-60bdf6639a70 tempest-VolumesSnapshotsTestJSON-20768876 None] Created volume successfully. Nov 01 12:23:59 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-62080752-a3fd-481c-a112-c888455d5cf0" returned: 0 in 0.679s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Lock "cinder-quobyte-62080752-a3fd-481c-a112-c888455d5cf0" released by "delete_volume" :: held 1.233s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Created reservations ['33408100-36db-4426-92af-cc2db8f081a7', '8c459d45-d797-44cc-9dad-860bb2a5a6f1', '2710051c-36d8-4f7c-81e5-36b2677b86f5', 'e7ed13a3-962e-45d9-9a97-303d2e2c3a95'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:59 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:23:59 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:59 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.310s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Acquiring lock "cinder-quobyte-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:59 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Deleted volume successfully. Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Lock "cinder-quobyte-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bdebfb35-28af-4972-9cea-13e753bf67eb tempest-VolumesCloneTest-1006123683 None] Lock "cinder-62080752-a3fd-481c-a112-c888455d5cf0-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b15de2b-d256-45a4-a5be-43009ff04d69]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:59 devstack sudo[92248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f Nov 01 12:23:59 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:00 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f" returned: 0 in 0.463s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:00 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f Nov 01 12:24:00 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Creating offline snapshot fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 of volume e2c48ddd-37ee-43dd-ad55-deab36ca6cac {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[134a3b3f-b3e3-464b-98fe-decc8272817a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:00 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Acquiring lock "cinder-2c809644-576a-44e6-a8e9-09e14108e739-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f" returned: 0 in 0.481s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Lock "cinder-2c809644-576a-44e6-a8e9-09e14108e739-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Lock "cinder-quobyte-81d0ecb2-0a39-4e2e-aed4-14dd4cc9934f" released by "delete_volume" :: held 1.071s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:00 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac Nov 01 12:24:00 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Acquiring lock "cinder-quobyte-2c809644-576a-44e6-a8e9-09e14108e739" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Lock "cinder-quobyte-2c809644-576a-44e6-a8e9-09e14108e739" acquired by "delete_volume" :: waited 0.049s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Created reservations ['008ce2fd-097c-4967-8dbd-32e31e94e9c5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f8356f-ed87-4954-b6c0-b68338aba843]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:01 devstack cinder-volume[86812]: WARNING cinder.quota [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-819478507 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-819478507, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:24:01 devstack cinder-volume[86812]: WARNING cinder.quota [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-819478507 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-819478507, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Created reservations ['2af2572b-8202-4090-9943-4eac187b2d5b', '1c0c1bdc-1088-4654-b985-7b849a4b5876', 'b2eb1041-141c-4b27-8fa7-3b9fcb740baa', '988c0375-b8b6-4eb5-99f5-405839662a84'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:01 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:01 devstack sudo[92262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" returned: 0 in 0.691s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:01 devstack sudo[92262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:01 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 1G Nov 01 12:24:01 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:01 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:01 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:01 devstack sudo[92262]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739" returned: 0 in 0.644s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:01 devstack sudo[92275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739 Nov 01 12:24:01 devstack sudo[92275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:02 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 1G" returned: 0 in 0.734s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:02 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.505s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:02 devstack sudo[92279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 Nov 01 12:24:02 devstack sudo[92279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:02 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b3649ab6-d9e7-4b5b-af27-4adce1cd66c8 tempest-GroupsTest-1555572700 None] Delete group completed successfully. Nov 01 12:24:02 devstack sudo[92275]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2c809644-576a-44e6-a8e9-09e14108e739" returned: 0 in 0.482s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Lock "cinder-quobyte-2c809644-576a-44e6-a8e9-09e14108e739" released by "delete_volume" :: held 1.246s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Created reservations ['295a3513-e2f2-4261-a592-d72afc01e279', '8ca55c33-4f54-4914-b2ca-9b51dcc0c12d', '06b00dd1-dc8b-48d0-942f-f4b29caf22e1', '9fff2603-b8d3-4eab-9a41-c19a77d5098c'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:02 devstack sudo[92279]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49" returned: 0 in 0.653s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:02 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 is being set with open permissions: ugo+rw Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:02 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:02 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:02 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 Nov 01 12:24:02 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-68f1bb7f-7808-4afb-9352-499a89d190ed tempest-GroupsTest-1555572700 None] Created reservations ['91138011-0e01-4263-96d9-a5029e57a482'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-68f1bb7f-7808-4afb-9352-499a89d190ed tempest-GroupsTest-1555572700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-68f1bb7f-7808-4afb-9352-499a89d190ed tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-68f1bb7f-7808-4afb-9352-499a89d190ed tempest-GroupsTest-1555572700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-68f1bb7f-7808-4afb-9352-499a89d190ed tempest-GroupsTest-1555572700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-68f1bb7f-7808-4afb-9352-499a89d190ed tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-68f1bb7f-7808-4afb-9352-499a89d190ed tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:03 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:03 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:03 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.353s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:03 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Deleted volume successfully. Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-160a4862-d566-49b4-8fd7-5868ea2e5dad tempest-VolumesCloneTest-1006123683 None] Lock "cinder-2c809644-576a-44e6-a8e9-09e14108e739-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:03 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49" returned: 0 in 0.484s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:03 devstack sudo[92294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.info Nov 01 12:24:03 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:03 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-68f1bb7f-7808-4afb-9352-499a89d190ed tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.533s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-68f1bb7f-7808-4afb-9352-499a89d190ed tempest-GroupsTest-1555572700 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:03 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-68f1bb7f-7808-4afb-9352-499a89d190ed tempest-GroupsTest-1555572700 None] Delete group completed successfully. Nov 01 12:24:03 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.info" returned: 0 in 0.543s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:03 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.info is being set with open permissions: ugo+rw Nov 01 12:24:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:03 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.info Nov 01 12:24:03 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:04 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.info" returned: 0 in 0.340s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.664s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:04 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-ba424190-8b10-4ee2-b49c-e7dcaf7977a3 req-3a634143-a5ac-4787-bf5c-273fb1d60ca3 tempest-VolumesSnapshotsTestJSON-20768876 None] Create snapshot completed successfully Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Acquiring lock "cinder-fd3cc6de-7137-40b8-9494-d2c1fc7e4d49-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "cinder-fd3cc6de-7137-40b8-9494-d2c1fc7e4d49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Acquiring lock "cinder-quobyte-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "cinder-quobyte-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Acquiring lock "cinder-quobyte-fd3cc6de-7137-40b8-9494-d2c1fc7e4d49" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "cinder-quobyte-fd3cc6de-7137-40b8-9494-d2c1fc7e4d49" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Deleting offline snapshot fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 of volume e2c48ddd-37ee-43dd-ad55-deab36ca6cac {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] snapshot_file for this snap is: volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff88217b-7090-4e67-a6be-8445b16cc307]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:05 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bc1c38f2-0829-4663-bf84-d139e3b4f892 tempest-GroupsTest-1555572700 None] Group tempest-GroupsTest-Group-1830614727: creating Nov 01 12:24:05 devstack sudo[92305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 Nov 01 12:24:05 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:05 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bc1c38f2-0829-4663-bf84-d139e3b4f892 tempest-GroupsTest-1555572700 None] Group tempest-GroupsTest-Group-1830614727: created successfully Nov 01 12:24:05 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bc1c38f2-0829-4663-bf84-d139e3b4f892 tempest-GroupsTest-1555572700 None] Create group completed successfully. Nov 01 12:24:05 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49" returned: 0 in 0.782s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:24:05 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce130d9-8bfc-4f82-9d9c-60b27a98585f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:05 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac Nov 01 12:24:05 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:06 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" returned: 0 in 0.551s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:06 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 Nov 01 12:24:06 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:07 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49" returned: 0 in 0.907s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:07 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49 Nov 01 12:24:07 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=93,cinder:SELECT=95,cinder:INSERT=29,cinder:DELETE=11 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Flow 'volume_create_manager' (f10dfd77-43e0-4d13-83a4-498ae02a670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a55777-31a3-4a78-8559-0735ce8e7e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a55777-31a3-4a78-8559-0735ce8e7e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-64398646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d029cc76-d624-45c5-b9c5-6825480ed201,host='devstack@QuobyteHD#QuobyteHD',id=3194d7bd-45c9-4bb5-9234-17a73fff8982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9e74c744eb4c77b53d846b9790f28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:07Z,use_quota=True,user_id='e7b229e3031d40ee81eaf3c84692e01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce8032d8-cb0f-43ce-afc1-9da3e32c8c50),volume_type_id=ce8032d8-cb0f-43ce-afc1-9da3e32c8c50)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a66a66e-4d72-45be-944b-ea22b8969bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a66a66e-4d72-45be-944b-ea22b8969bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ef68c6-52fd-4570-90cf-b7c36a79e260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ef68c6-52fd-4570-90cf-b7c36a79e260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3194d7bd-45c9-4bb5-9234-17a73fff8982', 'volume_name': 'volume-3194d7bd-45c9-4bb5-9234-17a73fff8982', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaf6a8a-bfc9-48a6-99e8-2767da2bdfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaf6a8a-bfc9-48a6-99e8-2767da2bdfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4a8de8-0bc2-41c5-b8a8-20b565aa7804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:07 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Volume 3194d7bd-45c9-4bb5-9234-17a73fff8982: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3194d7bd-45c9-4bb5-9234-17a73fff8982', 'volume_size': 1} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d029cc76-d624-45c5-b9c5-6825480ed201,created_at=2026-11-01T11:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-64398646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d029cc76-d624-45c5-b9c5-6825480ed201,host='devstack@QuobyteHD#QuobyteHD',id=3194d7bd-45c9-4bb5-9234-17a73fff8982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9e74c744eb4c77b53d846b9790f28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:07Z,use_quota=True,user_id='e7b229e3031d40ee81eaf3c84692e01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce8032d8-cb0f-43ce-afc1-9da3e32c8c50),volume_type_id=ce8032d8-cb0f-43ce-afc1-9da3e32c8c50)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Creating volume 3194d7bd-45c9-4bb5-9234-17a73fff8982 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:07 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:07 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982 1073741824 Nov 01 12:24:07 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:07 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac.fd3cc6de-7137-40b8-9494-d2c1fc7e4d49" returned: 0 in 0.714s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "cinder-quobyte-fd3cc6de-7137-40b8-9494-d2c1fc7e4d49" released by "_delete_snapshot" :: held 3.191s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "cinder-quobyte-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" released by "delete_snapshot" :: held 3.245s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG cinder.quota [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Created reservations ['7076ca63-9afe-4f24-b7bf-b30eaec6ca7d', '63c85f33-7703-4d26-86d1-a86de5333364', '77dee816-bb08-4e0f-a9f6-bef6b57e8405', '6015e8cc-476e-4158-bf33-e98e996e6f2e'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:08 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Delete snapshot completed successfully. Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5d9cc925-7dc2-489f-90c8-507a74cfaeb9 req-41e934ac-24a2-4f3b-8948-fdd7fac4ad26 tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "cinder-fd3cc6de-7137-40b8-9494-d2c1fc7e4d49-delete_snapshot" released by "delete_snapshot" :: held 3.568s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Acquiring lock "cinder-e2c48ddd-37ee-43dd-ad55-deab36ca6cac-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "cinder-e2c48ddd-37ee-43dd-ad55-deab36ca6cac-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:08 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982 1073741824" returned: 0 in 0.730s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Acquiring lock "cinder-quobyte-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "cinder-quobyte-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f454f40c-ca4a-4d6c-a988-f8a4eeac6d87]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:08 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982 Nov 01 12:24:08 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:08 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac Nov 01 12:24:08 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:09 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982" returned: 0 in 0.377s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4a8de8-0bc2-41c5-b8a8-20b565aa7804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3194d7bd-45c9-4bb5-9234-17a73fff8982', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa38c0f5-39d5-4c95-a0a9-72df145313ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:09 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Volume volume-3194d7bd-45c9-4bb5-9234-17a73fff8982 (3194d7bd-45c9-4bb5-9234-17a73fff8982): created successfully Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa38c0f5-39d5-4c95-a0a9-72df145313ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Flow 'volume_create_manager' (f10dfd77-43e0-4d13-83a4-498ae02a670f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-61a355de-91b6-456e-8e79-8de9b60de7a3 tempest-GroupsTest-1555572700 None] Created volume successfully. Nov 01 12:24:09 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" returned: 0 in 0.578s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:09 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac Nov 01 12:24:09 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:09 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" returned: 0 in 0.385s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "cinder-quobyte-e2c48ddd-37ee-43dd-ad55-deab36ca6cac" released by "delete_volume" :: held 1.072s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG cinder.quota [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Created reservations ['40380fdd-e4c9-4deb-8eab-1c22b87d285a', '5f20b64f-cab4-4028-b536-5d1ba91e07c7', '43c88768-e597-46e2-a516-adbed51fe6fc', '6c103a45-f235-47fb-9bf5-9c3217ff11e4'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:10 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:10 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:10 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.350s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:10 devstack cinder-volume[86812]: DEBUG cinder.manager [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:10 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Deleted volume successfully. Nov 01 12:24:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-5de47e3f-fe33-40db-b07b-cf5f04a966e3 req-fa06cdcd-c28d-4703-891e-5945eb9b3f3b tempest-VolumesSnapshotsTestJSON-20768876 None] Lock "cinder-e2c48ddd-37ee-43dd-ad55-deab36ca6cac-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Flow 'volume_create_manager' (3a83adb2-a030-4300-8e61-5428956dd196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc5225f-3379-4503-a794-bcc696193bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc5225f-3379-4503-a794-bcc696193bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381099277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d029cc76-d624-45c5-b9c5-6825480ed201,host='devstack@QuobyteHD#QuobyteHD',id=c8dc9ed4-d1ba-4d3f-965d-220d60e49bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9e74c744eb4c77b53d846b9790f28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:11Z,use_quota=True,user_id='e7b229e3031d40ee81eaf3c84692e01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce8032d8-cb0f-43ce-afc1-9da3e32c8c50),volume_type_id=ce8032d8-cb0f-43ce-afc1-9da3e32c8c50)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3e2454-2489-47ec-9cce-090ee96d8f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3e2454-2489-47ec-9cce-090ee96d8f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9efd8c77-75e6-4058-bcc8-fe837f7e516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9efd8c77-75e6-4058-bcc8-fe837f7e516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8dc9ed4-d1ba-4d3f-965d-220d60e49bec', 'volume_name': 'volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acec7eaa-470a-4b47-8c03-e5a943613d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acec7eaa-470a-4b47-8c03-e5a943613d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ceb223b-741e-4ad9-95fe-af23575d5cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:11 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Volume c8dc9ed4-d1ba-4d3f-965d-220d60e49bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec', 'volume_size': 1} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d029cc76-d624-45c5-b9c5-6825480ed201,created_at=2026-11-01T11:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381099277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d029cc76-d624-45c5-b9c5-6825480ed201,host='devstack@QuobyteHD#QuobyteHD',id=c8dc9ed4-d1ba-4d3f-965d-220d60e49bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e9e74c744eb4c77b53d846b9790f28a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:11Z,use_quota=True,user_id='e7b229e3031d40ee81eaf3c84692e01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce8032d8-cb0f-43ce-afc1-9da3e32c8c50),volume_type_id=ce8032d8-cb0f-43ce-afc1-9da3e32c8c50)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Creating volume c8dc9ed4-d1ba-4d3f-965d-220d60e49bec {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:11 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:11 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec 1073741824 Nov 01 12:24:11 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Flow 'volume_create_manager' (09ce1512-fd12-4d91-b3cf-a2afbe7e11f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3011437-0ed5-4d48-8e28-d7dcec2b8b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3011437-0ed5-4d48-8e28-d7dcec2b8b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-822273087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb43b42-3e1f-42a3-983b-6a2a28388ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e31cc1bf76a4d72b079733ed554e8ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:11Z,use_quota=True,user_id='ada71f89115c4e67bb5c01884c7b552a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a322c314-631c-4a85-ae09-0bdf01d940bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a322c314-631c-4a85-ae09-0bdf01d940bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851a00e7-0f3a-47c9-be35-7fbef2c9bcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851a00e7-0f3a-47c9-be35-7fbef2c9bcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb43b42-3e1f-42a3-983b-6a2a28388ba9', 'volume_name': 'volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9', 'volume_size': 2}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb04173a-07e0-4ce5-83e0-d24d7a7b5c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb04173a-07e0-4ce5-83e0-d24d7a7b5c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1760d29-126a-4f4c-8ffd-1e7e2cb457e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:11 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Volume 9bb43b42-3e1f-42a3-983b-6a2a28388ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9', 'volume_size': 2} Nov 01 12:24:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:12 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec 1073741824" returned: 0 in 0.615s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:12 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec Nov 01 12:24:12 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:12 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec" returned: 0 in 0.440s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.822s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-822273087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb43b42-3e1f-42a3-983b-6a2a28388ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e31cc1bf76a4d72b079733ed554e8ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:11Z,use_quota=True,user_id='ada71f89115c4e67bb5c01884c7b552a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Creating volume 9bb43b42-3e1f-42a3-983b-6a2a28388ba9 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:12 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9 2147483648 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:12 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9 2147483648 Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ceb223b-741e-4ad9-95fe-af23575d5cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:12 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824708d8-d89c-463a-ab05-09f11b9a7960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:12 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Volume volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec (c8dc9ed4-d1ba-4d3f-965d-220d60e49bec): created successfully Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824708d8-d89c-463a-ab05-09f11b9a7960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Flow 'volume_create_manager' (3a83adb2-a030-4300-8e61-5428956dd196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:12 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5f532c3c-954a-4087-ba21-9f8122e91387 tempest-GroupsTest-1555572700 None] Created volume successfully. Nov 01 12:24:12 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-c7951735-db99-479c-b4b1-3f2a5f516efa req-28e8dd20-4e8f-4430-8e33-41a21ca32d43 tempest-ServerActionsTestOtherA-456736643 None] Terminate volume connection completed successfully. Nov 01 12:24:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-c7951735-db99-479c-b4b1-3f2a5f516efa req-28e8dd20-4e8f-4430-8e33-41a21ca32d43 tempest-ServerActionsTestOtherA-456736643 None] Deleting attachment fe3ed3f9-d178-4bfc-b704-3c8aefca06c0. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:24:13 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9 2147483648" returned: 0 in 0.774s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:13 devstack sudo[92420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9 Nov 01 12:24:13 devstack sudo[92420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:13 devstack sudo[92420]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9" returned: 0 in 0.373s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1760d29-126a-4f4c-8ffd-1e7e2cb457e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9', 'volume_size': 2}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bdad47-5093-44ab-92a5-aeb56f06ab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:13 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Volume volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9 (9bb43b42-3e1f-42a3-983b-6a2a28388ba9): created successfully Nov 01 12:24:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2bdad47-5093-44ab-92a5-aeb56f06ab78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Flow 'volume_create_manager' (09ce1512-fd12-4d91-b3cf-a2afbe7e11f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:13 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bd7ebc0d-cc10-4475-af82-bb1e4ff3c8da tempest-VolumesCloneNegativeTest-834566465 None] Created volume successfully. Nov 01 12:24:14 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c45a4ed9-c540-41fd-ae37-40fe5dc34a20 tempest-GroupsTest-1555572700 None] Update group completed successfully. Nov 01 12:24:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Acquiring lock "cinder-9bb43b42-3e1f-42a3-983b-6a2a28388ba9-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Lock "cinder-9bb43b42-3e1f-42a3-983b-6a2a28388ba9-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Acquiring lock "cinder-quobyte-9bb43b42-3e1f-42a3-983b-6a2a28388ba9" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Lock "cinder-quobyte-9bb43b42-3e1f-42a3-983b-6a2a28388ba9" acquired by "delete_volume" :: waited 0.032s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:14 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfe1c75-945c-4ece-aa3f-ee1eff57de08]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-c7951735-db99-479c-b4b1-3f2a5f516efa req-bfdf37d2-c440-418e-a3c9-71900986c6b7 tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-c7951735-db99-479c-b4b1-3f2a5f516efa req-bfdf37d2-c440-418e-a3c9-71900986c6b7 tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:14 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9 Nov 01 12:24:14 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-c7951735-db99-479c-b4b1-3f2a5f516efa req-bfdf37d2-c440-418e-a3c9-71900986c6b7 tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-c7951735-db99-479c-b4b1-3f2a5f516efa req-bfdf37d2-c440-418e-a3c9-71900986c6b7 tempest-ServerActionsTestOtherA-456736643 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-6ce93605-8a36-45a5-92d2-7e92d3720652', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b3dc6bb-3237-4fe4-aa8c-0e42b54d2780', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:24:14 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-c7951735-db99-479c-b4b1-3f2a5f516efa req-bfdf37d2-c440-418e-a3c9-71900986c6b7 tempest-ServerActionsTestOtherA-456736643 None] attachment_update completed successfully. Nov 01 12:24:15 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9" returned: 0 in 0.495s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:15 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9 Nov 01 12:24:15 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:15 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bb43b42-3e1f-42a3-983b-6a2a28388ba9" returned: 0 in 0.361s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Lock "cinder-quobyte-9bb43b42-3e1f-42a3-983b-6a2a28388ba9" released by "delete_volume" :: held 0.938s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:15 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-645ef751-b564-4c17-9802-1562aca4be65 tempest-GroupsTest-1555572700 None] Update group completed successfully. Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Created reservations ['213a4c2b-545e-4557-a8f3-84f5363faf07', '90ba5f04-6893-4602-b380-2bcbcb54bdc6', 'abc851e9-8717-4501-add6-6ee54f98727d', 'b21321c8-a777-49e3-ab67-cb08cdbf9df1'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:15 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:15 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:16 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.407s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:16 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Deleted volume successfully. Nov 01 12:24:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3f5000f6-c014-4408-a9d9-119ebe6ea53c tempest-VolumesCloneNegativeTest-834566465 None] Lock "cinder-9bb43b42-3e1f-42a3-983b-6a2a28388ba9-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:16 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Flow 'volume_create_manager' (1964c5a3-02aa-4906-af43-b29c3dacd7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba76d51-5a56-4f52-b63f-bd8d8a4e4a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ba76d51-5a56-4f52-b63f-bd8d8a4e4a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1040257806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5434cc9-34d9-452c-acac-747648b97455,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631609322ff845d0843283f07a53d3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:17Z,use_quota=True,user_id='557fc32309544b3ea87ff2d6d987b498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7164133a-e8e5-4944-9d86-48f01eb3538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7164133a-e8e5-4944-9d86-48f01eb3538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f981db-5e54-4b8a-81a6-f684cb2d33a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f981db-5e54-4b8a-81a6-f684cb2d33a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5434cc9-34d9-452c-acac-747648b97455', 'volume_name': 'volume-e5434cc9-34d9-452c-acac-747648b97455', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618df2f4-319e-4917-a6cb-f48e9ffac298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618df2f4-319e-4917-a6cb-f48e9ffac298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13659b89-dc06-4414-9dbe-460b20ae5323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:17 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Volume e5434cc9-34d9-452c-acac-747648b97455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5434cc9-34d9-452c-acac-747648b97455', 'volume_size': 1} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1040257806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5434cc9-34d9-452c-acac-747648b97455,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631609322ff845d0843283f07a53d3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:17Z,use_quota=True,user_id='557fc32309544b3ea87ff2d6d987b498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Creating volume e5434cc9-34d9-452c-acac-747648b97455 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:17 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:17 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455 1073741824 Nov 01 12:24:17 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Acquiring lock "cinder-quobyte-3194d7bd-45c9-4bb5-9234-17a73fff8982" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Lock "cinder-quobyte-3194d7bd-45c9-4bb5-9234-17a73fff8982" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[70731e4e-4415-44c7-b029-985b0e6838fa]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:17 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455 1073741824" returned: 0 in 0.777s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:17 devstack sudo[92905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982 Nov 01 12:24:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:17 devstack sudo[92905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:18 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455 Nov 01 12:24:18 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:18 devstack sudo[92905]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982" returned: 0 in 0.636s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:18 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982 Nov 01 12:24:18 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:18 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455" returned: 0 in 0.522s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13659b89-dc06-4414-9dbe-460b20ae5323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5434cc9-34d9-452c-acac-747648b97455', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00536fdf-b714-45f7-a4b6-28672652be6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:18 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Volume volume-e5434cc9-34d9-452c-acac-747648b97455 (e5434cc9-34d9-452c-acac-747648b97455): created successfully Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00536fdf-b714-45f7-a4b6-28672652be6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Flow 'volume_create_manager' (1964c5a3-02aa-4906-af43-b29c3dacd7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:18 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f81aef23-cb64-48cf-9d25-6965e723c1a3 tempest-VolumesTestJSON-212579900 None] Created volume successfully. Nov 01 12:24:18 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3194d7bd-45c9-4bb5-9234-17a73fff8982" returned: 0 in 0.367s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Lock "cinder-quobyte-3194d7bd-45c9-4bb5-9234-17a73fff8982" released by "delete_volume" :: held 1.108s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Acquiring lock "cinder-quobyte-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Lock "cinder-quobyte-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7200e0-c4df-4515-8daf-b91e94a59b9e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:18 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec Nov 01 12:24:18 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:19 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec" returned: 0 in 0.499s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:19 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec Nov 01 12:24:19 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:19 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec" returned: 0 in 0.509s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Lock "cinder-quobyte-c8dc9ed4-d1ba-4d3f-965d-220d60e49bec" released by "delete_volume" :: held 1.091s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:19 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Created reservations ['96b81404-c02a-4371-b196-5e7ea8d795f6'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:20 devstack cinder-volume[86812]: WARNING cinder.quota [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1545861581 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1545861581, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:24:20 devstack cinder-volume[86812]: WARNING cinder.quota [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1545861581 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1545861581, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Created reservations ['ca24f6ef-559f-4bbe-9489-47815a758ac4', '35172032-4919-4b31-808d-7e4a16d8a5c8', '1ec52d27-420e-4dea-bb89-a864e36d0026', '6fb4eb70-2d76-436b-846e-d4258b77e0c1'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Flow 'volume_create_manager' (2f8593ff-7811-46a1-9e2b-81137a6b6f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ecedff-72aa-4f2f-9471-befd65e5a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ecedff-72aa-4f2f-9471-befd65e5a239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1576575561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631609322ff845d0843283f07a53d3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:20Z,use_quota=True,user_id='557fc32309544b3ea87ff2d6d987b498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee57c9d-1fb8-4573-91c4-efd5a3640d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee57c9d-1fb8-4573-91c4-efd5a3640d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3122c589-4626-4cab-a27e-8b27a006faa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3122c589-4626-4cab-a27e-8b27a006faa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc', 'volume_name': 'volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c561d3-1cfd-4bce-846a-98db737edd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c561d3-1cfd-4bce-846a-98db737edd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d886b6a-fcff-444e-9473-d8a6274a7ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:20 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Volume 4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc', 'volume_size': 1} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1576575561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631609322ff845d0843283f07a53d3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:20Z,use_quota=True,user_id='557fc32309544b3ea87ff2d6d987b498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Creating volume 4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:20 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Created reservations ['67bacf11-fb43-4736-b1c1-96d732579f25', '52edf834-a445-4f2b-ae40-8356e05cb730', 'c4c1fa40-61ba-42cf-861e-f6ef15afbbb3', '95476aed-67dd-4a31-830f-5d3578d6f75c'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:20 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc 1073741824 Nov 01 12:24:20 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:20 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:20 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:21 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.418s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:21 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:21 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-334b10f7-d97a-45b7-9dc6-364794395ef1 tempest-GroupsTest-1555572700 None] Delete group completed successfully. Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc 1073741824" returned: 0 in 0.746s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:21 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc Nov 01 12:24:21 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:21 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc" returned: 0 in 0.498s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] <== create_volume: return (1317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d886b6a-fcff-444e-9473-d8a6274a7ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4555afae-e1db-4a6b-a6c7-80e8bf08cac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:21 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Volume volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc (4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc): created successfully Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4555afae-e1db-4a6b-a6c7-80e8bf08cac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Flow 'volume_create_manager' (2f8593ff-7811-46a1-9e2b-81137a6b6f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:21 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ac45ec40-2698-4ad9-8a4f-d3bcab56284f tempest-VolumesTestJSON-212579900 None] Created volume successfully. Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Flow 'volume_create_manager' (fb6b7681-9cb6-4adf-bdbc-8f01c87758c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c869790-68cc-48b4-adc1-6d7a1cb785fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c869790-68cc-48b4-adc1-6d7a1cb785fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1045365256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc74b86-d233-47b2-b6f3-7d148408342e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631609322ff845d0843283f07a53d3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:23Z,use_quota=True,user_id='557fc32309544b3ea87ff2d6d987b498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d109ef16-8735-4414-b20e-1d599f445d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d109ef16-8735-4414-b20e-1d599f445d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a3f36b-dce5-4787-85cf-4a40969c698b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a3f36b-dce5-4787-85cf-4a40969c698b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc74b86-d233-47b2-b6f3-7d148408342e', 'volume_name': 'volume-9bc74b86-d233-47b2-b6f3-7d148408342e', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eb46c8-3805-4bcf-a84d-d1df946ff5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80eb46c8-3805-4bcf-a84d-d1df946ff5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbc5272-6302-4b24-a336-a9ac8ee653e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:23 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Volume 9bc74b86-d233-47b2-b6f3-7d148408342e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc74b86-d233-47b2-b6f3-7d148408342e', 'volume_size': 1} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1045365256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc74b86-d233-47b2-b6f3-7d148408342e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='631609322ff845d0843283f07a53d3fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:23Z,use_quota=True,user_id='557fc32309544b3ea87ff2d6d987b498',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Creating volume 9bc74b86-d233-47b2-b6f3-7d148408342e {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:23 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:23 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e 1073741824 Nov 01 12:24:23 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (49229896-fd13-4996-9799-baabc9de330f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d670701-27d7-454d-9aa0-a0eb83566e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d670701-27d7-454d-9aa0-a0eb83566e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1723189582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8bcc6f-1946-4bc0-a24c-81f71dfe1023,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:24Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1716ae-e66b-4b84-ada9-ec861bac239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1716ae-e66b-4b84-ada9-ec861bac239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b33ca51-e512-4408-9886-50c8319c1cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b33ca51-e512-4408-9886-50c8319c1cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8bcc6f-1946-4bc0-a24c-81f71dfe1023', 'volume_name': 'volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54affc97-fe75-42a7-bc23-e152438aff53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54affc97-fe75-42a7-bc23-e152438aff53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48269a5-1a1e-4b2d-8b4f-decec0a407c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:24 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Volume 9d8bcc6f-1946-4bc0-a24c-81f71dfe1023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023', 'volume_size': 1} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:24 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e 1073741824" returned: 0 in 0.706s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:24 devstack sudo[92946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e Nov 01 12:24:24 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:24 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e" returned: 0 in 0.257s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.339s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1723189582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8bcc6f-1946-4bc0-a24c-81f71dfe1023,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:24Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Creating volume 9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:24 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bbc5272-6302-4b24-a336-a9ac8ee653e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc74b86-d233-47b2-b6f3-7d148408342e', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab23780-2ee0-450c-8955-13506738918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:24 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 1073741824 Nov 01 12:24:24 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:24 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Volume volume-9bc74b86-d233-47b2-b6f3-7d148408342e (9bc74b86-d233-47b2-b6f3-7d148408342e): created successfully Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab23780-2ee0-450c-8955-13506738918a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Flow 'volume_create_manager' (fb6b7681-9cb6-4adf-bdbc-8f01c87758c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:24 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3d96f77c-ad4d-428a-bcc5-219a93062625 tempest-VolumesTestJSON-212579900 None] Created volume successfully. Nov 01 12:24:25 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 1073741824" returned: 0 in 0.535s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:25 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 Nov 01 12:24:25 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:25 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023" returned: 0 in 0.343s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48269a5-1a1e-4b2d-8b4f-decec0a407c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab89d96-efb1-4635-b7d7-636894d5d887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Volume volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 (9d8bcc6f-1946-4bc0-a24c-81f71dfe1023): created successfully Nov 01 12:24:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab89d96-efb1-4635-b7d7-636894d5d887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (49229896-fd13-4996-9799-baabc9de330f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5a30ecf0-18d1-4289-9cbd-1b925df84212 tempest-VolumesGetTest-477119949 None] Created volume successfully. Nov 01 12:24:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Acquiring lock "cinder-9bc74b86-d233-47b2-b6f3-7d148408342e-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Lock "cinder-9bc74b86-d233-47b2-b6f3-7d148408342e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Acquiring lock "cinder-quobyte-9bc74b86-d233-47b2-b6f3-7d148408342e" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Lock "cinder-quobyte-9bc74b86-d233-47b2-b6f3-7d148408342e" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:26 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[34003987-16ff-4ac5-b598-30ce7fccd5df]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:27 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e Nov 01 12:24:27 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:27 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e" returned: 0 in 0.582s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:27 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e Nov 01 12:24:27 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (dff30009-bfcf-48c9-b8ad-d89aec29b29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59122e2a-4c65-4173-967b-631cf5acbfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59122e2a-4c65-4173-967b-631cf5acbfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1960473655',display_name='tempest-VolumesGetTest-Volume-1905639021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c81fa1-3c15-491c-a9ba-f137be6aacb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:28Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba9cb52-3387-4d45-8fb1-21749973c3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba9cb52-3387-4d45-8fb1-21749973c3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebc71c4-2def-4893-af3b-6fa77784f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebc71c4-2def-4893-af3b-6fa77784f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c81fa1-3c15-491c-a9ba-f137be6aacb6', 'volume_name': 'volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850a8913-a9a0-4b77-809a-4f393a619955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850a8913-a9a0-4b77-809a-4f393a619955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b883c188-b9f4-4417-a6d0-c0ca7bb7a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:27 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Volume 13c81fa1-3c15-491c-a9ba-f137be6aacb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6', 'volume_size': 1} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1960473655',display_name='tempest-VolumesGetTest-Volume-1905639021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c81fa1-3c15-491c-a9ba-f137be6aacb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:28Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Creating volume 13c81fa1-3c15-491c-a9ba-f137be6aacb6 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:27 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:27 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6 1073741824 Nov 01 12:24:27 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:27 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9bc74b86-d233-47b2-b6f3-7d148408342e" returned: 0 in 0.377s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Lock "cinder-quobyte-9bc74b86-d233-47b2-b6f3-7d148408342e" released by "delete_volume" :: held 1.029s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Created reservations ['76a91c84-a427-4f12-a6c4-306d79d2e522', 'cae42067-f0fb-4297-9be6-5951adf6be1e', '1fbcaa38-e309-4780-913b-619afaa3595c', '145df0ec-7654-4cc5-89d9-396745222167'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:28 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:28 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:28 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.328s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Deleted volume successfully. Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e6e0a7-d421-4943-bad4-3c402b3dd5aa tempest-VolumesTestJSON-212579900 None] Lock "cinder-9bc74b86-d233-47b2-b6f3-7d148408342e-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:28 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6 1073741824" returned: 0 in 0.640s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:28 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6 Nov 01 12:24:28 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:28 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6" returned: 0 in 0.277s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b883c188-b9f4-4417-a6d0-c0ca7bb7a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666a3b6f-ccef-409b-98ad-536ae17f5e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:28 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Volume volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6 (13c81fa1-3c15-491c-a9ba-f137be6aacb6): created successfully Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666a3b6f-ccef-409b-98ad-536ae17f5e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (dff30009-bfcf-48c9-b8ad-d89aec29b29b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8113da78-882d-4e3f-b79f-461c9dedaa08 tempest-VolumesGetTest-477119949 None] Created volume successfully. Nov 01 12:24:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Acquiring lock "cinder-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Lock "cinder-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Acquiring lock "cinder-quobyte-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Lock "cinder-quobyte-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[504fc2ce-1321-41b3-9d36-f7d9289566a7]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:29 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc Nov 01 12:24:29 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:29 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc" returned: 0 in 0.413s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:29 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc Nov 01 12:24:29 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:30 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-13c81fa1-3c15-491c-a9ba-f137be6aacb6-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc" returned: 0 in 0.347s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Lock "cinder-quobyte-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc" released by "delete_volume" :: held 0.820s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Lock "cinder-13c81fa1-3c15-491c-a9ba-f137be6aacb6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-quobyte-13c81fa1-3c15-491c-a9ba-f137be6aacb6" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Created reservations ['5a47f89d-d769-41fb-86ce-75d242d9d78e', 'eed6e0a9-f8d8-4f4e-893b-780131f65530', '192bb17d-82fa-4273-9c19-56a7d5ce395c', '36fbfaae-6e4c-4d7f-9302-e0a7d3b1b87d'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-13c81fa1-3c15-491c-a9ba-f137be6aacb6" acquired by "delete_volume" :: waited 0.032s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88cb617-cf4a-4e3e-bce2-a085e39f2997]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Acquiring lock "cinder-e5434cc9-34d9-452c-acac-747648b97455-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Lock "cinder-e5434cc9-34d9-452c-acac-747648b97455-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:30 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:30 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Acquiring lock "cinder-quobyte-e5434cc9-34d9-452c-acac-747648b97455" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Lock "cinder-quobyte-e5434cc9-34d9-452c-acac-747648b97455" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:30 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6 Nov 01 12:24:30 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf46da1-d071-4f8e-bdec-3a3023558e16]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:30 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455 Nov 01 12:24:30 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:30 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.577s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:30 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Deleted volume successfully. Nov 01 12:24:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1e1a427-114f-48d3-b7c2-9d25e6adc6d6 tempest-VolumesTestJSON-212579900 None] Lock "cinder-4971e6ea-be6d-4cb2-a1f0-f5d408e50dfc-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:30 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6" returned: 0 in 0.736s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:31 devstack sudo[92997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6 Nov 01 12:24:31 devstack sudo[92997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:31 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455" returned: 0 in 0.638s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:31 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455 Nov 01 12:24:31 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Flow 'volume_create_manager' (d968bcc4-57de-40c0-81fa-9bd42be6fddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a8965f-a54d-452d-b66b-4d7f6b0a461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a8965f-a54d-452d-b66b-4d7f6b0a461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-975591442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad57638c-3484-451f-b2ff-1e41cfb5e8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41873b846ffd4949b07aa5b96057986a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:31Z,use_quota=True,user_id='e2353da645e74bbfa3176d4b5806e019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97580c67-d1b2-417f-964e-d86495dacb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97580c67-d1b2-417f-964e-d86495dacb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f708ccb-5d54-43d6-b78e-10e0c9e00a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f708ccb-5d54-43d6-b78e-10e0c9e00a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad57638c-3484-451f-b2ff-1e41cfb5e8de', 'volume_name': 'volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8faae8d5-217e-43b4-9047-65b8722a69ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8faae8d5-217e-43b4-9047-65b8722a69ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0383272f-cab8-49ed-a51d-283d76f98096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:31 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Volume ad57638c-3484-451f-b2ff-1e41cfb5e8de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de', 'volume_size': 1} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-975591442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad57638c-3484-451f-b2ff-1e41cfb5e8de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41873b846ffd4949b07aa5b96057986a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:31Z,use_quota=True,user_id='e2353da645e74bbfa3176d4b5806e019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Creating volume ad57638c-3484-451f-b2ff-1e41cfb5e8de {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:31 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:31 devstack sudo[92997]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13c81fa1-3c15-491c-a9ba-f137be6aacb6" returned: 0 in 0.425s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:31 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de 1073741824 Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-13c81fa1-3c15-491c-a9ba-f137be6aacb6" released by "delete_volume" :: held 1.224s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:31 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Created reservations ['19e8ff36-b17f-4bb3-a279-f1e1978209e2', '4dafddd4-c700-41d9-bbc3-6798c1e6688a', '2e726a61-e1fd-448b-9714-2f1e8e7888ab', 'e90b2bb6-db1f-4711-b150-aa72c56f8ff7'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:31 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e5434cc9-34d9-452c-acac-747648b97455" returned: 0 in 0.346s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Lock "cinder-quobyte-e5434cc9-34d9-452c-acac-747648b97455" released by "delete_volume" :: held 1.068s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Created reservations ['dc09953a-7519-44a1-8960-70264ffebd4f', '2d628468-181b-4c69-a843-f5c921fe858f', '578473ab-e5d8-43f6-865b-9dea8112cc7c', 'c5eb831c-b92f-4e2d-9474-16f9a6d77fb7'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:31 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:31 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:31 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:31 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:31 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de 1073741824" returned: 0 in 0.517s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:31 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.308s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:31 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Deleted volume successfully. Nov 01 12:24:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9151d86e-5f27-4095-995a-0c1aab41e29f tempest-VolumesGetTest-477119949 None] Lock "cinder-13c81fa1-3c15-491c-a9ba-f137be6aacb6-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:32 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de Nov 01 12:24:32 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:32 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.307s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:32 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Deleted volume successfully. Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce049a06-65fc-466f-b1dd-ad2e40308671 tempest-VolumesTestJSON-212579900 None] Lock "cinder-e5434cc9-34d9-452c-acac-747648b97455-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:32 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0383272f-cab8-49ed-a51d-283d76f98096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b008bb2c-2f8f-403e-be65-3607a687d9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:32 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Volume volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de (ad57638c-3484-451f-b2ff-1e41cfb5e8de): created successfully Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b008bb2c-2f8f-403e-be65-3607a687d9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Flow 'volume_create_manager' (d968bcc4-57de-40c0-81fa-9bd42be6fddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:32 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-95b7ea5f-05df-4896-b655-b6e4f30c0c51 tempest-VolumeQuotasAdminTestJSON-956441135 None] Created volume successfully. Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Lock "cinder-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-quobyte-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a48279-1aa0-4532-a0c6-1c49613a72cf]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:32 devstack sudo[93021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 Nov 01 12:24:32 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:32 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023" returned: 0 in 0.410s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:33 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023 Nov 01 12:24:33 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:33 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023" released by "delete_volume" :: held 0.724s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Created reservations ['70949686-14a9-46f8-8af5-5255b6d8229e', '69b3f9ea-ca97-44ba-b022-39ed12bfc2ba', '072feb7e-6590-47a4-a84e-205101cc4df0', 'c57085ba-d417-44c9-97ba-b69f36b9b9fc'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Acquiring lock "cinder-ad57638c-3484-451f-b2ff-1e41cfb5e8de-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "cinder-ad57638c-3484-451f-b2ff-1e41cfb5e8de-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:33 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:33 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Acquiring lock "cinder-quobyte-ad57638c-3484-451f-b2ff-1e41cfb5e8de" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "cinder-quobyte-ad57638c-3484-451f-b2ff-1e41cfb5e8de" acquired by "delete_volume" :: waited 0.039s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f020fa-a3af-41c4-8629-d3a525c75906]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:33 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de Nov 01 12:24:33 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:33 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.449s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:33 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Deleted volume successfully. Nov 01 12:24:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08083bc7-0561-4866-8925-94a01740510e tempest-VolumesGetTest-477119949 None] Lock "cinder-9d8bcc6f-1946-4bc0-a24c-81f71dfe1023-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:34 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de" returned: 0 in 0.552s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:34 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de Nov 01 12:24:34 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:34 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (733cdd62-aa01-4abf-ab85-1a01d63a9df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25e2ee5-10cf-41c2-83ad-0578a4b139ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ad57638c-3484-451f-b2ff-1e41cfb5e8de" returned: 0 in 0.406s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b25e2ee5-10cf-41c2-83ad-0578a4b139ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1438932432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ac71c0-7fc1-449a-9363-663e75cfba58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:35Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8e46c7-1bd6-4ecd-9942-9049efa7d1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8e46c7-1bd6-4ecd-9942-9049efa7d1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94264e2-30bd-4d5e-88a8-c5ee62424aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94264e2-30bd-4d5e-88a8-c5ee62424aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ac71c0-7fc1-449a-9363-663e75cfba58', 'volume_name': 'volume-86ac71c0-7fc1-449a-9363-663e75cfba58', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2d1d5a-5c30-44b5-b901-c5a3f7d87bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2d1d5a-5c30-44b5-b901-c5a3f7d87bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b5ac07-b26e-432e-ad10-869a90346268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:34 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Volume 86ac71c0-7fc1-449a-9363-663e75cfba58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ac71c0-7fc1-449a-9363-663e75cfba58', 'volume_size': 1} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1438932432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ac71c0-7fc1-449a-9363-663e75cfba58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:35Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Creating volume 86ac71c0-7fc1-449a-9363-663e75cfba58 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:34 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "cinder-quobyte-ad57638c-3484-451f-b2ff-1e41cfb5e8de" released by "delete_volume" :: held 1.133s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:34 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 1073741824 Nov 01 12:24:34 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Created reservations ['4227c8c6-343f-439d-a960-e7b7f2025494', '6dc03f7b-637b-4d8d-b64b-8ee4df73339b', '498e214f-9754-4480-88d5-ab3ba46f254e', '7ba4b6a4-f098-4bf2-9cfc-0c7572af52a3'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:34 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:34 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:35 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.316s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Deleted volume successfully. Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c5458f37-9720-49c2-a1c2-f90ec7f84b5c tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "cinder-ad57638c-3484-451f-b2ff-1e41cfb5e8de-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:35 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 1073741824" returned: 0 in 0.615s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:35 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 Nov 01 12:24:35 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:35 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58" returned: 0 in 0.342s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b5ac07-b26e-432e-ad10-869a90346268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ac71c0-7fc1-449a-9363-663e75cfba58', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02017e2c-e968-477a-9b3f-b605be19a22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:35 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Volume volume-86ac71c0-7fc1-449a-9363-663e75cfba58 (86ac71c0-7fc1-449a-9363-663e75cfba58): created successfully Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02017e2c-e968-477a-9b3f-b605be19a22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (733cdd62-aa01-4abf-ab85-1a01d63a9df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-20417c1d-190b-4b83-8c3d-5cac92192196 tempest-VolumesGetTest-477119949 None] Created volume successfully. Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Flow 'volume_create_manager' (bbe61dc5-4032-47e8-b9a4-769312dad6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fa272e-998d-4cf9-ba51-92a28ab2feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18fa272e-998d-4cf9-ba51-92a28ab2feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1271345964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27208259-d66c-430c-be83-a42aa3616634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41873b846ffd4949b07aa5b96057986a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:36Z,use_quota=True,user_id='e2353da645e74bbfa3176d4b5806e019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2788f9a-da90-4079-b2c8-b4f09e2fdb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2788f9a-da90-4079-b2c8-b4f09e2fdb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc97f17e-94f0-4497-8683-2eeb3c25ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc97f17e-94f0-4497-8683-2eeb3c25ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27208259-d66c-430c-be83-a42aa3616634', 'volume_name': 'volume-27208259-d66c-430c-be83-a42aa3616634', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ab71da-b365-4838-b0bf-daaeccfb6f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ab71da-b365-4838-b0bf-daaeccfb6f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02de7453-b71f-4126-b59d-3fbd542f34bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:36 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Volume 27208259-d66c-430c-be83-a42aa3616634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27208259-d66c-430c-be83-a42aa3616634', 'volume_size': 1} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1271345964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27208259-d66c-430c-be83-a42aa3616634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41873b846ffd4949b07aa5b96057986a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:36Z,use_quota=True,user_id='e2353da645e74bbfa3176d4b5806e019',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Creating volume 27208259-d66c-430c-be83-a42aa3616634 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:36 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:36 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634 1073741824 Nov 01 12:24:36 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:36 devstack sudo[93100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:37 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:37 devstack sudo[93100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634 1073741824" returned: 0 in 0.570s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:37 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634 Nov 01 12:24:37 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (f65585eb-e3d0-4a25-a6a3-83b3c8bcaddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ba9440-eeb4-4797-b0f1-3a8632be98f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ba9440-eeb4-4797-b0f1-3a8632be98f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-888339315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce945541-5333-4746-a251-f581d547d10d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=86ac71c0-7fc1-449a-9363-663e75cfba58,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:37Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:37 devstack sudo[93100]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ab2bd6-7039-456f-b02d-9fc4b30ae285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ab2bd6-7039-456f-b02d-9fc4b30ae285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0439f0c-f560-46a3-bd18-0dc55b343553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.426s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0439f0c-f560-46a3-bd18-0dc55b343553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ce945541-5333-4746-a251-f581d547d10d', 'volume_name': 'volume-ce945541-5333-4746-a251-f581d547d10d', 'volume_size': 1, 'source_volid': '86ac71c0-7fc1-449a-9363-663e75cfba58', 'source_volstatus': 'available'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:37 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2727736-2d94-46cd-bf67-9389ce3ce740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2727736-2d94-46cd-bf67-9389ce3ce740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55336059-8e0c-45c9-b0d1-d534e86eb18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:37 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Volume ce945541-5333-4746-a251-f581d547d10d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ce945541-5333-4746-a251-f581d547d10d', 'volume_size': 1, 'source_volid': '86ac71c0-7fc1-449a-9363-663e75cfba58', 'source_volstatus': 'available'} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634" returned: 0 in 0.361s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02de7453-b71f-4126-b59d-3fbd542f34bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27208259-d66c-430c-be83-a42aa3616634', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7443ad47-64e4-4dac-a92b-eac6476f2b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:37 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Cloning volume 86ac71c0-7fc1-449a-9363-663e75cfba58 to volume ce945541-5333-4746-a251-f581d547d10d Nov 01 12:24:37 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Volume volume-27208259-d66c-430c-be83-a42aa3616634 (27208259-d66c-430c-be83-a42aa3616634): created successfully Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7443ad47-64e4-4dac-a92b-eac6476f2b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Flow 'volume_create_manager' (bbe61dc5-4032-47e8-b9a4-769312dad6f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Creating offline snapshot 8072d687-d82c-4ff5-a34c-43e65eac1243 of volume 86ac71c0-7fc1-449a-9363-663e75cfba58 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:24:37 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-47ba6efe-1c2c-4dad-97d4-f13af8ecec67 tempest-VolumeQuotasAdminTestJSON-956441135 None] Created volume successfully. Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae5376e-5c1b-4e41-a6b4-b8e69ad9d0e4]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:37 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 Nov 01 12:24:37 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:37 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58" returned: 0 in 0.384s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:37 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 1G Nov 01 12:24:37 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:38 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 1G" returned: 0 in 0.457s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ac71c0-7fc1-449a-9363-663e75cfba58 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:38 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ac71c0-7fc1-449a-9363-663e75cfba58 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 Nov 01 12:24:38 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:38 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86ac71c0-7fc1-449a-9363-663e75cfba58 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243" returned: 0 in 0.418s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:38 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 is being set with open permissions: ugo+rw Nov 01 12:24:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:38 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 Nov 01 12:24:38 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:39 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243" returned: 0 in 0.308s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:39 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.info Nov 01 12:24:39 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-969d9f51-e921-41c4-b4b6-f5fec873b8d5 tempest-VolumeQuotasAdminTestJSON-1956436421 None] Transfer volume completed successfully. Nov 01 12:24:39 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.info" returned: 0 in 0.302s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:39 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.info is being set with open permissions: ugo+rw Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:39 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.info Nov 01 12:24:39 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:39 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.info" returned: 0 in 0.273s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-quobyte-ce945541-5333-4746-a251-f581d547d10d" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-ce945541-5333-4746-a251-f581d547d10d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] snapshot: 8072d687-d82c-4ff5-a34c-43e65eac1243, volume: ce945541-5333-4746-a251-f581d547d10d, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[63af3287-ba11-45cf-9911-2d541cb751ba]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Acquiring lock "cinder-27208259-d66c-430c-be83-a42aa3616634-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Lock "cinder-27208259-d66c-430c-be83-a42aa3616634-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Acquiring lock "cinder-quobyte-27208259-d66c-430c-be83-a42aa3616634" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:39 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 Nov 01 12:24:39 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Lock "cinder-quobyte-27208259-d66c-430c-be83-a42aa3616634" acquired by "delete_volume" :: waited 0.026s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[408e3e92-5a58-47f9-ac2a-8a79a6d84dc8]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:40 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634 Nov 01 12:24:40 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:40 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243" returned: 0 in 0.410s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86ac71c0-7fc1-449a-9363-663e75cfba58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb02ea7-d9bf-4dcc-9c7c-5e568b74b252]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:40 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 Nov 01 12:24:40 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:40 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634" returned: 0 in 0.409s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:40 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634 Nov 01 12:24:40 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:40 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58" returned: 0 in 0.412s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:40 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:40 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d Nov 01 12:24:40 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27208259-d66c-430c-be83-a42aa3616634" returned: 0 in 0.298s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Lock "cinder-quobyte-27208259-d66c-430c-be83-a42aa3616634" released by "delete_volume" :: held 0.764s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Created reservations ['ebf67c2b-51de-4eeb-966f-508eb98dcd9d', 'ff08e0b1-3800-4ec7-9606-cc9bd080f226', 'c51b3f64-5298-4051-9507-7ed5acc1a389', '381d5ae8-bcf2-4215-8a68-79df7a17b2cb'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:40 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:40 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:41 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.291s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:41 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:41 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Deleted volume successfully. Nov 01 12:24:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c748cabc-8d93-41b9-a674-b3b67c7bcdf2 tempest-VolumeQuotasAdminTestJSON-240236789 None] Lock "cinder-27208259-d66c-430c-be83-a42aa3616634-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-be2858d2-62e9-4bab-8069-4b198375d96d tempest-GroupsV314Test-1756350606 None] Group tempest-GroupsV314Test-Group-208579617: creating Nov 01 12:24:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-be2858d2-62e9-4bab-8069-4b198375d96d tempest-GroupsV314Test-1756350606 None] Group tempest-GroupsV314Test-Group-208579617: created successfully Nov 01 12:24:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-be2858d2-62e9-4bab-8069-4b198375d96d tempest-GroupsV314Test-1756350606 None] Create group completed successfully. Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Flow 'volume_create_manager' (ff591718-c483-4465-ae31-47d883d0eaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f36239-7c8c-4be4-916e-d8d02b349194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f36239-7c8c-4be4-916e-d8d02b349194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1268376112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=172c7c16-e387-4b7b-9750-112a4939c73b,host='devstack@QuobyteHD#QuobyteHD',id=1b5cdee8-94ca-4246-a5bd-8144f244b7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faca3706a0dd490a89f0bb2b028651df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:46Z,use_quota=True,user_id='64b766e85db54a2e8f5fc848549f415b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb82076-e039-4f8b-8d36-c971bb31da0a),volume_type_id=2bb82076-e039-4f8b-8d36-c971bb31da0a)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800c8604-1360-45f9-85e7-75aaf79bb15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800c8604-1360-45f9-85e7-75aaf79bb15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191cd57a-cf0e-4ca4-af9a-c89d9bb90b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (191cd57a-cf0e-4ca4-af9a-c89d9bb90b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5cdee8-94ca-4246-a5bd-8144f244b7c1', 'volume_name': 'volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9cabb8-27db-4391-856a-73b537061244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9cabb8-27db-4391-856a-73b537061244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e3d841-e2ea-4e6d-b233-27198646df33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:46 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Volume 1b5cdee8-94ca-4246-a5bd-8144f244b7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1', 'volume_size': 1} Nov 01 12:24:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:50 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d" returned: 0 in 10.223s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:50 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58, size 1024.00 MB, duration 10.22 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:24:50 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Converted 1024.00 MB image at 100.16 MB/s Nov 01 12:24:50 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d is being set with open permissions: ugo+rw Nov 01 12:24:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:50 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d Nov 01 12:24:50 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:51 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d" returned: 0 in 0.269s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-ce945541-5333-4746-a251-f581d547d10d" released by "_copy_volume_from_snapshot" :: held 11.412s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-quobyte-8072d687-d82c-4ff5-a34c-43e65eac1243" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-8072d687-d82c-4ff5-a34c-43e65eac1243" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Deleting offline snapshot 8072d687-d82c-4ff5-a34c-43e65eac1243 of volume 86ac71c0-7fc1-449a-9363-663e75cfba58 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] snapshot_file for this snap is: volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f21d62-a09c-49d2-99f8-34d3afe219c6]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:51 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-29a2f4d9-ffaf-4178-9aa7-00e371dd8064 tempest-ServerActionsTestOtherA-456736643 None] Terminate volume connection completed successfully. Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-29a2f4d9-ffaf-4178-9aa7-00e371dd8064 tempest-ServerActionsTestOtherA-456736643 None] Deleting attachment 5b3dc6bb-3237-4fe4-aa8c-0e42b54d2780. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:24:51 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 Nov 01 12:24:51 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "cinder-6ce93605-8a36-45a5-92d2-7e92d3720652-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Lock "cinder-6ce93605-8a36-45a5-92d2-7e92d3720652-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "cinder-quobyte-6ce93605-8a36-45a5-92d2-7e92d3720652" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Lock "cinder-quobyte-6ce93605-8a36-45a5-92d2-7e92d3720652" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[03786b1b-0f21-4cac-b6cf-3fd77ee6fa2f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:51 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243" returned: 0 in 0.454s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86ac71c0-7fc1-449a-9363-663e75cfba58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caccff7-96a4-42e7-aa8a-e6d8327efd18]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:51 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 Nov 01 12:24:51 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:51 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 Nov 01 12:24:51 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:52 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652" returned: 0 in 0.557s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:52 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652 Nov 01 12:24:52 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:52 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6ce93605-8a36-45a5-92d2-7e92d3720652" returned: 0 in 0.288s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:52 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58" returned: 0 in 0.743s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Lock "cinder-quobyte-6ce93605-8a36-45a5-92d2-7e92d3720652" released by "delete_volume" :: held 0.932s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:52 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 Nov 01 12:24:52 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG cinder.quota [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Created reservations ['ddb4f51d-b89c-4ba0-8375-2db4affd14c7', '69f28bac-e284-43ae-8c19-5e6a42b7251d', 'e5ef4319-dba5-422d-9aef-288ae8efd2bf', '46cd0698-a7a9-47e8-8d65-d309735daad9'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:52 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:52 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:52 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243" returned: 0 in 0.366s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:52 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243 Nov 01 12:24:52 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:52 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.283s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG cinder.manager [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:52 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Deleted volume successfully. Nov 01 12:24:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-8b39c490-ea2e-481f-92d4-efa444c5a8e5 req-66eb89ec-7ca3-4ec4-9bf0-35ae96e529c7 tempest-ServerActionsTestOtherA-456736643 None] Lock "cinder-6ce93605-8a36-45a5-92d2-7e92d3720652-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:53 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58.8072d687-d82c-4ff5-a34c-43e65eac1243" returned: 0 in 0.297s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-8072d687-d82c-4ff5-a34c-43e65eac1243" released by "_delete_snapshot" :: held 2.033s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.817s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.654s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=172c7c16-e387-4b7b-9750-112a4939c73b,created_at=2026-11-01T11:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1268376112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=172c7c16-e387-4b7b-9750-112a4939c73b,host='devstack@QuobyteHD#QuobyteHD',id=1b5cdee8-94ca-4246-a5bd-8144f244b7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faca3706a0dd490a89f0bb2b028651df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:46Z,use_quota=True,user_id='64b766e85db54a2e8f5fc848549f415b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bb82076-e039-4f8b-8d36-c971bb31da0a),volume_type_id=2bb82076-e039-4f8b-8d36-c971bb31da0a)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Creating volume 1b5cdee8-94ca-4246-a5bd-8144f244b7c1 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:53 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:53 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 1073741824 Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55336059-8e0c-45c9-b0d1-d534e86eb18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce945541-5333-4746-a251-f581d547d10d', 'volume_size': 1, 'source_volid': '86ac71c0-7fc1-449a-9363-663e75cfba58', 'source_volstatus': 'available'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:53 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8829038-d249-4987-a439-378def89439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:53 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Volume volume-ce945541-5333-4746-a251-f581d547d10d (ce945541-5333-4746-a251-f581d547d10d): created successfully Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8829038-d249-4987-a439-378def89439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (f65585eb-e3d0-4a25-a6a3-83b3c8bcaddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:53 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a6fd3aec-3bab-41bf-8de6-9e0f60e5939a tempest-VolumesGetTest-477119949 None] Created volume successfully. Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "cinder-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Lock "cinder-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "cinder-quobyte-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Lock "cinder-quobyte-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b" acquired by "delete_volume" :: waited 0.028s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e21a42a-650e-440a-be49-c6ec8131b375]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:53 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b Nov 01 12:24:53 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:53 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 1073741824" returned: 0 in 0.542s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:53 devstack sudo[93257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 Nov 01 12:24:53 devstack sudo[93257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:53 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b" returned: 0 in 0.435s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:54 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b Nov 01 12:24:54 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:54 devstack sudo[93257]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1" returned: 0 in 0.297s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e3d841-e2ea-4e6d-b233-27198646df33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179d7cab-7f72-4941-9291-d448de4e0a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:54 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Volume volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 (1b5cdee8-94ca-4246-a5bd-8144f244b7c1): created successfully Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179d7cab-7f72-4941-9291-d448de4e0a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Flow 'volume_create_manager' (ff591718-c483-4465-ae31-47d883d0eaed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:54 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1c3665de-3ba7-415c-b04c-fb5272a6a6a9 tempest-GroupsV314Test-1756350606 None] Created volume successfully. Nov 01 12:24:54 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b" returned: 0 in 0.322s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Lock "cinder-quobyte-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b" released by "delete_volume" :: held 0.819s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Created reservations ['f9e3e389-ae91-4bd9-b272-c3b3a64eab6d', '2ad19edd-4a96-4b77-bb00-bc8e40371cdf', 'dfdec3de-9cde-4d32-bc9f-41d55449d920', '8e6869c6-9eb8-4088-9901-ede1905dae6d'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:54 devstack sudo[93266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:54 devstack sudo[93266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:54 devstack sudo[93266]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.276s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:54 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Deleted volume successfully. Nov 01 12:24:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7fb7f15-5beb-435c-aacd-5649e6dd0b8d tempest-ServerActionsTestOtherA-456736643 None] Lock "cinder-2bd3ff2e-1fd0-476d-8fd5-8cac099f5c9b-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (0f3c0992-ad8c-46ea-909c-b6fc60de8f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e1f6b9-7441-47f6-a6e3-61418ce4f9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e1f6b9-7441-47f6-a6e3-61418ce4f9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1399496237',display_name='tempest-VolumesGetTest-Volume-875962821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0753d562-9cec-4067-9a69-f1025e94a3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:55Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb5016e-fdd6-4681-a129-d93203f90690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb5016e-fdd6-4681-a129-d93203f90690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1f725e-a9be-4550-ae14-7e8f60d00d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1f725e-a9be-4550-ae14-7e8f60d00d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0753d562-9cec-4067-9a69-f1025e94a3fe', 'volume_name': 'volume-0753d562-9cec-4067-9a69-f1025e94a3fe', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f20ae7-5d22-4521-ba56-cafbc2715c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f20ae7-5d22-4521-ba56-cafbc2715c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e433f84f-864d-4257-ba53-9aaf476faa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:55 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Volume 0753d562-9cec-4067-9a69-f1025e94a3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0753d562-9cec-4067-9a69-f1025e94a3fe', 'volume_size': 1} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1399496237',display_name='tempest-VolumesGetTest-Volume-875962821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0753d562-9cec-4067-9a69-f1025e94a3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:55Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Creating volume 0753d562-9cec-4067-9a69-f1025e94a3fe {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:55 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:24:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:55 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe 1073741824 Nov 01 12:24:55 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:56 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe 1073741824" returned: 0 in 0.699s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=204,cinder:SELECT=153,cinder:INSERT=37,cinder:DELETE=11 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:56 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe Nov 01 12:24:56 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:56 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe" returned: 0 in 0.490s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:56 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Cloning volume 1b5cdee8-94ca-4246-a5bd-8144f244b7c1 to volume 60b1c91e-3c39-43ed-8776-fdf9484dd096 Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e433f84f-864d-4257-ba53-9aaf476faa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0753d562-9cec-4067-9a69-f1025e94a3fe', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15a29bd-5198-4add-8489-a1441767ff49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:56 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Volume volume-0753d562-9cec-4067-9a69-f1025e94a3fe (0753d562-9cec-4067-9a69-f1025e94a3fe): created successfully Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e15a29bd-5198-4add-8489-a1441767ff49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (0f3c0992-ad8c-46ea-909c-b6fc60de8f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Creating offline snapshot a955dd92-a987-47ba-a562-50f80fc85fcb of volume 1b5cdee8-94ca-4246-a5bd-8144f244b7c1 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:24:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7b989e8a-9f5f-4e6a-bb90-ebb5a46aadd6 tempest-VolumesGetTest-477119949 None] Created volume successfully. Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c48670-5da8-4c0b-a0ed-4cac7cda795c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:56 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 Nov 01 12:24:56 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:57 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1" returned: 0 in 0.597s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:57 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb 1G Nov 01 12:24:57 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-0753d562-9cec-4067-9a69-f1025e94a3fe-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Lock "cinder-0753d562-9cec-4067-9a69-f1025e94a3fe-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-quobyte-0753d562-9cec-4067-9a69-f1025e94a3fe" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-0753d562-9cec-4067-9a69-f1025e94a3fe" acquired by "delete_volume" :: waited 0.034s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:57 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdd679e-0320-489d-a6ca-a342ba74969a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:58 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe Nov 01 12:24:58 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:58 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb 1G" returned: 0 in 0.761s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:58 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb Nov 01 12:24:58 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:58 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe" returned: 0 in 0.486s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:58 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe Nov 01 12:24:58 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:58 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb" returned: 0 in 0.422s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:58 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:58 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb Nov 01 12:24:58 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:58 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0753d562-9cec-4067-9a69-f1025e94a3fe" returned: 0 in 0.330s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-0753d562-9cec-4067-9a69-f1025e94a3fe" released by "delete_volume" :: held 0.903s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Created reservations ['fcdb9fc4-6c5f-4b21-813e-efd373d34dbd', 'd2a9f2eb-5b4f-46c1-80b8-148a1f56e381', 'b7ac6fe6-9b7d-4f54-9118-4f3f03d77a12', '45eede8b-943d-4c65-bcd9-e4c341a0ae5c'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:59 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb" returned: 0 in 0.401s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:59 devstack sudo[93368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:24:59 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:59 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.info Nov 01 12:24:59 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:59 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.318s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:59 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Deleted volume successfully. Nov 01 12:24:59 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.info" returned: 0 in 0.278s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:59 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad86c4be-6dd3-4cfb-8a7a-60a1575b0f9e tempest-VolumesGetTest-477119949 None] Lock "cinder-0753d562-9cec-4067-9a69-f1025e94a3fe-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:59 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.info Nov 01 12:24:59 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:59 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.info" returned: 0 in 0.311s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Acquiring lock "cinder-quobyte-60b1c91e-3c39-43ed-8776-fdf9484dd096" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Lock "cinder-quobyte-60b1c91e-3c39-43ed-8776-fdf9484dd096" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] snapshot: a955dd92-a987-47ba-a562-50f80fc85fcb, volume: 60b1c91e-3c39-43ed-8776-fdf9484dd096, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa4e723-2a64-4b17-bab1-e221a9ca1a5e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:59 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb Nov 01 12:24:59 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-ce945541-5333-4746-a251-f581d547d10d-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Lock "cinder-ce945541-5333-4746-a251-f581d547d10d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-quobyte-ce945541-5333-4746-a251-f581d547d10d" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-ce945541-5333-4746-a251-f581d547d10d" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:00 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb" returned: 0 in 0.552s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6188f886-7415-4fbc-8d3b-d5a3109c26fc]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db107db-338a-4c8b-b5c2-52af3de3b41f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:00 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d Nov 01 12:25:00 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:00 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 Nov 01 12:25:00 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:00 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1" returned: 0 in 0.408s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:00 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d" returned: 0 in 0.451s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:00 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 Nov 01 12:25:00 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:00 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d Nov 01 12:25:00 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:01 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ce945541-5333-4746-a251-f581d547d10d" returned: 0 in 0.329s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-ce945541-5333-4746-a251-f581d547d10d" released by "delete_volume" :: held 0.850s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Created reservations ['6acfe70a-8100-4787-94d9-a61dc0ed0c61', 'd5487456-ae8f-422e-b360-5f753b02e60f', 'a93dde4d-b4fd-42ab-ac6a-7cc38e7b35ea', '3845f577-5aaf-49db-87bc-fd79e9dd5c0e'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:01 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:25:01 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-86ac71c0-7fc1-449a-9363-663e75cfba58-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Lock "cinder-86ac71c0-7fc1-449a-9363-663e75cfba58-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-quobyte-86ac71c0-7fc1-449a-9363-663e75cfba58" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-86ac71c0-7fc1-449a-9363-663e75cfba58" acquired by "delete_volume" :: waited 0.040s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9513e9-866e-4111-a372-d2e64edb79b9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:02 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.732s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:02 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:02 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Deleted volume successfully. Nov 01 12:25:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f9d0277e-0fdb-4f4a-b074-62f9467d129f tempest-VolumesGetTest-477119949 None] Lock "cinder-ce945541-5333-4746-a251-f581d547d10d-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:02 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 Nov 01 12:25:02 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:02 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58" returned: 0 in 0.632s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:02 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58 Nov 01 12:25:02 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:03 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86ac71c0-7fc1-449a-9363-663e75cfba58" returned: 0 in 0.511s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-86ac71c0-7fc1-449a-9363-663e75cfba58" released by "delete_volume" :: held 1.337s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:03 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Created reservations ['3d4a0ef7-1863-4e06-b5fa-f73bb386ef35', '325e6815-efdb-4519-bfc2-c3711e6e4863', '6df528ca-31f9-498f-bb64-3bec6c10bcd4', '3eff6604-2991-4149-8d8e-49e2ca189a32'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:03 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:25:03 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:04 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.574s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:04 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:04 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Deleted volume successfully. Nov 01 12:25:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-553266d1-677d-4a9b-885f-467a1b446636 tempest-VolumesGetTest-477119949 None] Lock "cinder-86ac71c0-7fc1-449a-9363-663e75cfba58-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Flow 'volume_create_manager' (f0b0dc83-a0f0-4211-a76e-60ddb31e111f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635859ba-36e1-4fc9-8709-00428b21257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (635859ba-36e1-4fc9-8709-00428b21257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1550218445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3641eef-c57f-499d-bfed-6e7a726dd7ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d6ff9fd65c4304b4fc3c29649e6384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:05Z,use_quota=True,user_id='76a3dd94b0b14ffd9e72b3a5cb10072e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(818973c8-24fd-4eee-9160-f42f5be9d98a),volume_type_id=818973c8-24fd-4eee-9160-f42f5be9d98a)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837dccd9-9414-4e41-af1e-3494f31d721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837dccd9-9414-4e41-af1e-3494f31d721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf730be-b982-43bd-869c-a93691786700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf730be-b982-43bd-869c-a93691786700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3641eef-c57f-499d-bfed-6e7a726dd7ff', 'volume_name': 'volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b93d72-d419-4abe-9450-1e777380d599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b93d72-d419-4abe-9450-1e777380d599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e70f73-12af-45fe-861f-f1723acef736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:05 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Volume a3641eef-c57f-499d-bfed-6e7a726dd7ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff', 'volume_size': 1} Nov 01 12:25:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:06 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (0e61e405-1535-4fe4-a0d0-70b476a520bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d608f2e-b3f7-4e38-a7ab-948f6761d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d608f2e-b3f7-4e38-a7ab-948f6761d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1711807252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1639c52-1255-4399-b9a1-42fc66643240,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:07Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478c8acd-2130-41de-8c15-17bc258cde21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478c8acd-2130-41de-8c15-17bc258cde21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a770a4af-d0ac-4df5-aaf2-addcd8636f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:06 devstack cinder-volume[86812]: DEBUG cinder.image.glance [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Creating Keystone auth plugin from conf {{(pid=86812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:25:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a770a4af-d0ac-4df5-aaf2-addcd8636f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b1639c52-1255-4399-b9a1-42fc66643240', 'volume_name': 'volume-b1639c52-1255-4399-b9a1-42fc66643240', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9076752b-546a-43ac-8a64-921dda788f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9076752b-546a-43ac-8a64-921dda788f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0913db03-7f01-43fd-8a1f-829f545a611d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:07 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Volume b1639c52-1255-4399-b9a1-42fc66643240: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b1639c52-1255-4399-b9a1-42fc66643240', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 12:25:07 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Trying to clone b1639c52-1255-4399-b9a1-42fc66643240 from image c5fdc172-8826-4b34-a68d-2114e120626b at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]). {{(pid=86812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:25:08 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:25:08 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Image download 20.69 MB at 20.69 MB/s Nov 01 12:25:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[17439755-c205-47f0-9e8c-081896dc75dd]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:08 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD Nov 01 12:25:08 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:08 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD" returned: 0 in 0.582s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:08 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Temporary image c5fdc172-8826-4b34-a68d-2114e120626b is fetched for user 00a6ea5eacff4883b8f6f08a61ee0835. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:25:08 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=154,cinder:INSERT=53,cinder:UPDATE=185,cinder:DELETE=17 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:25:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f9e660-47f3-4735-b330-388f4fe0e815]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:09 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD Nov 01 12:25:09 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:09 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:09 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096" returned: 0 in 9.224s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:09 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1, size 1024.00 MB, duration 9.22 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:25:09 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Converted 1024.00 MB image at 111.00 MB/s Nov 01 12:25:09 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:25:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:10 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 Nov 01 12:25:10 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:10 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096" returned: 0 in 0.248s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Lock "cinder-quobyte-60b1c91e-3c39-43ed-8776-fdf9484dd096" released by "_copy_volume_from_snapshot" :: held 10.534s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Acquiring lock "cinder-quobyte-a955dd92-a987-47ba-a562-50f80fc85fcb" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Lock "cinder-quobyte-a955dd92-a987-47ba-a562-50f80fc85fcb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Deleting offline snapshot a955dd92-a987-47ba-a562-50f80fc85fcb of volume 1b5cdee8-94ca-4246-a5bd-8144f244b7c1 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] snapshot_file for this snap is: volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bf859b-da52-46a6-8749-3d2df44a79dd]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:10 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb Nov 01 12:25:10 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:10 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb" returned: 0 in 0.429s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d0e1d-0295-44a9-b6a8-689216ac91f4]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:10 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 Nov 01 12:25:10 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:11 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1" returned: 0 in 0.551s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:11 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb Nov 01 12:25:11 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:11 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb" returned: 0 in 0.449s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:11 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb Nov 01 12:25:11 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:12 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1.a955dd92-a987-47ba-a562-50f80fc85fcb" returned: 0 in 0.293s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Lock "cinder-quobyte-a955dd92-a987-47ba-a562-50f80fc85fcb" released by "_delete_snapshot" :: held 1.833s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.491s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.679s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1550218445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3641eef-c57f-499d-bfed-6e7a726dd7ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d6ff9fd65c4304b4fc3c29649e6384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:05Z,use_quota=True,user_id='76a3dd94b0b14ffd9e72b3a5cb10072e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(818973c8-24fd-4eee-9160-f42f5be9d98a),volume_type_id=818973c8-24fd-4eee-9160-f42f5be9d98a)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Creating volume a3641eef-c57f-499d-bfed-6e7a726dd7ff {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:12 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:12 devstack sudo[93888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff 1073741824 Nov 01 12:25:12 devstack sudo[93888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:12 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1418947c-9da9-48b0-94ef-b7cc9c3c04e5 tempest-GroupsV314Test-1756350606 None] Create group from source-group-172c7c16-e387-4b7b-9750-112a4939c73b completed successfully. Nov 01 12:25:12 devstack sudo[93888]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff 1073741824" returned: 0 in 0.470s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:12 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff Nov 01 12:25:12 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:12 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.414s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1711807252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1639c52-1255-4399-b9a1-42fc66643240,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:07Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Creating volume b1639c52-1255-4399-b9a1-42fc66643240 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:12 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:12 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 1073741824 Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e70f73-12af-45fe-861f-f1723acef736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:12 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191826f2-7f9d-4721-a620-792a1c25f958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:13 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Volume volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff (a3641eef-c57f-499d-bfed-6e7a726dd7ff): created successfully Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191826f2-7f9d-4721-a620-792a1c25f958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Flow 'volume_create_manager' (f0b0dc83-a0f0-4211-a76e-60ddb31e111f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:13 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8ae2acb2-1a1d-45ca-9580-d1eb28409204 tempest-VolumeTypesAccessTest-822436562 None] Created volume successfully. Nov 01 12:25:13 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 1073741824" returned: 0 in 0.515s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:13 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 Nov 01 12:25:13 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Acquiring lock "cinder-quobyte-60b1c91e-3c39-43ed-8776-fdf9484dd096" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Lock "cinder-quobyte-60b1c91e-3c39-43ed-8776-fdf9484dd096" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9118c3-3ecd-4e0e-8244-087b921dabc5]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:13 devstack sudo[93906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 Nov 01 12:25:13 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Acquiring lock "cinder-a3641eef-c57f-499d-bfed-6e7a726dd7ff-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:13 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Lock "cinder-a3641eef-c57f-499d-bfed-6e7a726dd7ff-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240" returned: 0 in 0.422s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Attempting download of c5fdc172-8826-4b34-a68d-2114e120626b ((None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}])) to volume b1639c52-1255-4399-b9a1-42fc66643240. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:25:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Acquiring lock "cinder-quobyte-a3641eef-c57f-499d-bfed-6e7a726dd7ff" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Lock "cinder-quobyte-a3641eef-c57f-499d-bfed-6e7a726dd7ff" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65cdb75-d786-4ab3-a04b-b0ec0e19e7c9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[48599d0f-fe08-4f31-a860-56260783b9f1]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:14 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_z56_o_oa {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096" returned: 0 in 0.487s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:14 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096 Nov 01 12:25:14 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:14 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff Nov 01 12:25:14 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:14 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_z56_o_oa Nov 01 12:25:14 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:14 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-60b1c91e-3c39-43ed-8776-fdf9484dd096" returned: 0 in 0.334s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Lock "cinder-quobyte-60b1c91e-3c39-43ed-8776-fdf9484dd096" released by "delete_volume" :: held 0.887s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:14 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_z56_o_oa" returned: 0 in 0.439s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_z56_o_oa {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:14 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff" returned: 0 in 0.504s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Created reservations ['e34842f1-ec15-4310-8af0-aec220526240'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:14 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff Nov 01 12:25:14 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:14 devstack cinder-volume[86812]: WARNING cinder.quota [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1019913822 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1019913822, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:14 devstack cinder-volume[86812]: WARNING cinder.quota [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1019913822 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1019913822, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Created reservations ['cf7c20d0-1c21-4fd9-bff6-fe81d781d5cc', 'cb5037a6-a774-4513-9c54-65416a68f9e5', 'd9eca5ec-bdf0-4b18-bf86-2eba5f398fba', '837887aa-86d8-4eff-b8b0-7ba092a2dff8'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:14 devstack sudo[93925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_z56_o_oa Nov 01 12:25:14 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:14 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:25:14 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:14 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_z56_o_oa" returned: 1 in 0.375s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_z56_o_oa' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9629fb8e-4632-46c8-9a36-3455741d7141]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:14 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a3641eef-c57f-499d-bfed-6e7a726dd7ff" returned: 0 in 0.364s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Lock "cinder-quobyte-a3641eef-c57f-499d-bfed-6e7a726dd7ff" released by "delete_volume" :: held 0.947s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:15 devstack cinder-volume[86812]: WARNING cinder.quota [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-534238974 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-534238974, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:15 devstack cinder-volume[86812]: WARNING cinder.quota [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-534238974 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-534238974, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Created reservations ['5f571211-112c-4629-ada7-c118ffaa21f6', 'b26609fd-4d61-4aac-a0b1-3f13dc0e1a83', 'd8d7dcef-ef97-47d3-8c56-4aae9eeb5985', '33a1079b-b966-4cf1-835d-fc3e1172bd6e'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:15 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD Nov 01 12:25:15 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:15 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.376s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:15 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-58da5d9b-4068-47d4-85ec-bf3cd61dcd8d tempest-GroupsV314Test-1756350606 None] Delete group completed successfully. Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:15 devstack sudo[93937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:25:15 devstack sudo[93937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Acquiring lock "cinder-quobyte-1b5cdee8-94ca-4246-a5bd-8144f244b7c1" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Lock "cinder-quobyte-1b5cdee8-94ca-4246-a5bd-8144f244b7c1" acquired by "delete_volume" :: waited 0.032s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9de2909-65dc-4b1e-b0a9-520fd28e0ce3]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:15 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] c5fdc172-8826-4b34-a68d-2114e120626b was qcow2, converting to qcow2 {{(pid=86812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:15 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 Nov 01 12:25:15 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:15 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 Nov 01 12:25:15 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:15 devstack sudo[93937]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.363s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:15 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Deleted volume successfully. Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-37d12fdf-462b-4e7d-b9cc-9beff018b7b3 tempest-VolumeTypesAccessTest-822436562 None] Lock "cinder-a3641eef-c57f-499d-bfed-6e7a726dd7ff-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:15 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1" returned: 0 in 0.535s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:15 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1 Nov 01 12:25:15 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:16 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1b5cdee8-94ca-4246-a5bd-8144f244b7c1" returned: 0 in 0.304s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Lock "cinder-quobyte-1b5cdee8-94ca-4246-a5bd-8144f244b7c1" released by "delete_volume" :: held 0.947s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:16 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Created reservations ['b32a66bd-cad3-4110-84ee-b98ce3f3bfb4'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:16 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Created reservations ['0adc6e78-2dd7-4606-8e35-c356dd2bdb2b', 'bbd6cd1b-2729-4de2-8bf5-def8f634674d', 'b6356bcd-58ef-4ae4-9548-b7d40e9017bf', '3b739aea-bdd5-480f-966d-8b2020789372'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:16 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:25:16 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:17 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.403s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:17 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:17 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-130b196d-4699-4753-9791-3f5940dcd6d5 tempest-GroupsV314Test-1756350606 None] Delete group completed successfully. Nov 01 12:25:18 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240" returned: 0 in 3.079s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:18 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_uxxfpnzidevstack@QuobyteHD, size 112.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:25:18 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Converted 112.00 MB image at 36.36 MB/s Nov 01 12:25:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:18 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 1G Nov 01 12:25:18 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:19 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 1G" returned: 0 in 0.583s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:19 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Downloaded image c5fdc172-8826-4b34-a68d-2114e120626b ((None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}])) to volume b1639c52-1255-4399-b9a1-42fc66643240 successfully. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:25:19 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Temporary image c5fdc172-8826-4b34-a68d-2114e120626b for user 00a6ea5eacff4883b8f6f08a61ee0835 is deleted. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:25:19 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Marking volume b1639c52-1255-4399-b9a1-42fc66643240 as bootable. {{(pid=86812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:25:19 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Copying metadata from image c5fdc172-8826-4b34-a68d-2114e120626b to b1639c52-1255-4399-b9a1-42fc66643240. {{(pid=86812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:25:19 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Creating volume glance metadata for volume b1639c52-1255-4399-b9a1-42fc66643240 backed by image c5fdc172-8826-4b34-a68d-2114e120626b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:25:19 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0913db03-7f01-43fd-8a1f-829f545a611d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1639c52-1255-4399-b9a1-42fc66643240', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:19 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90dfe74a-293e-441c-a6c4-b22ab36e9173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:19 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Volume volume-b1639c52-1255-4399-b9a1-42fc66643240 (b1639c52-1255-4399-b9a1-42fc66643240): created successfully Nov 01 12:25:19 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90dfe74a-293e-441c-a6c4-b22ab36e9173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:19 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (0e61e405-1535-4fe4-a0d0-70b476a520bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:19 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-536bd41c-b292-4033-bf4a-1baeb921d8db tempest-VolumesGetTest-477119949 None] Created volume successfully. Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (1a6a0279-88ea-44b8-8393-a029a61d60bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74402ec5-0d5a-4983-89df-796c94ef0b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74402ec5-0d5a-4983-89df-796c94ef0b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-674515468',display_name='tempest-VolumesGetTest-Volume-544461766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9da618-8221-4cfd-8ffd-c0d20ad99412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:20Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fb024c-4c16-4f54-b3ce-9365a487ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24fb024c-4c16-4f54-b3ce-9365a487ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54b94ab-d925-44bf-accd-176507692094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54b94ab-d925-44bf-accd-176507692094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab9da618-8221-4cfd-8ffd-c0d20ad99412', 'volume_name': 'volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad6214d-1f9a-4a07-84c5-d4245b128407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad6214d-1f9a-4a07-84c5-d4245b128407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5219dfad-1da2-4a63-88e7-cee132d4c712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:20 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Volume ab9da618-8221-4cfd-8ffd-c0d20ad99412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412', 'volume_size': 1} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-674515468',display_name='tempest-VolumesGetTest-Volume-544461766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9da618-8221-4cfd-8ffd-c0d20ad99412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9f27757aee481c8c96a823c5f18f6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:20Z,use_quota=True,user_id='00a6ea5eacff4883b8f6f08a61ee0835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Creating volume ab9da618-8221-4cfd-8ffd-c0d20ad99412 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:20 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:25:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:20 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412 1073741824 Nov 01 12:25:20 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:21 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412 1073741824" returned: 0 in 0.693s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:21 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412 Nov 01 12:25:21 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:21 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412" returned: 0 in 0.434s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5219dfad-1da2-4a63-88e7-cee132d4c712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b22516b-172d-4007-916e-4c80ea7a9cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:21 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Volume volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412 (ab9da618-8221-4cfd-8ffd-c0d20ad99412): created successfully Nov 01 12:25:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b22516b-172d-4007-916e-4c80ea7a9cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Flow 'volume_create_manager' (1a6a0279-88ea-44b8-8393-a029a61d60bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:21 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-2ee015ff-1ce9-4776-ba65-91fd9a8b2f84 tempest-VolumesGetTest-477119949 None] Created volume successfully. Nov 01 12:25:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-ab9da618-8221-4cfd-8ffd-c0d20ad99412-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Lock "cinder-ab9da618-8221-4cfd-8ffd-c0d20ad99412-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-quobyte-ab9da618-8221-4cfd-8ffd-c0d20ad99412" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-ab9da618-8221-4cfd-8ffd-c0d20ad99412" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:22 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f228f27-fcdf-435f-a691-54eb763872c5]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:23 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412 Nov 01 12:25:23 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:23 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412" returned: 0 in 0.458s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:23 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412 Nov 01 12:25:23 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:23 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab9da618-8221-4cfd-8ffd-c0d20ad99412" returned: 0 in 0.360s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-ab9da618-8221-4cfd-8ffd-c0d20ad99412" released by "delete_volume" :: held 0.887s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Created reservations ['aef8c630-d7c1-4c6e-919b-f23a056d475a', 'ad2e0c5e-8313-42e7-b805-c58b79f3d482', 'd87be2c9-ddd2-4d66-b9c4-f59fcfe38299', '206ae739-a577-4f0e-96f2-3724e9bc948e'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:24 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:25:24 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-b1639c52-1255-4399-b9a1-42fc66643240-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Lock "cinder-b1639c52-1255-4399-b9a1-42fc66643240-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Acquiring lock "cinder-quobyte-b1639c52-1255-4399-b9a1-42fc66643240" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-b1639c52-1255-4399-b9a1-42fc66643240" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bf09e5-1c95-465a-b6e4-7730079ec1ed]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:24 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.395s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:24 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Deleted volume successfully. Nov 01 12:25:24 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 Nov 01 12:25:24 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a7469688-5abb-4cce-936b-ee1f98852cc9 tempest-VolumesGetTest-477119949 None] Lock "cinder-ab9da618-8221-4cfd-8ffd-c0d20ad99412-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:24 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240" returned: 0 in 0.508s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:24 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240 Nov 01 12:25:24 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:25 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1639c52-1255-4399-b9a1-42fc66643240" returned: 0 in 0.281s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Lock "cinder-quobyte-b1639c52-1255-4399-b9a1-42fc66643240" released by "delete_volume" :: held 0.882s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Created reservations ['48062909-ec3e-4969-a56f-520c00a8c6fc', 'af75d1a0-0d53-4db9-8f7c-b14d4ea4f10b', '32f7839d-42df-4791-8289-a2ee67f79067', '719c8c50-13a2-46e2-a3bc-545e7d62942b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:25 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:25:25 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:25 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.268s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Deleted volume successfully. Nov 01 12:25:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d5e09ff2-1948-4a0b-82bc-e4cf28651a4c tempest-VolumesGetTest-477119949 None] Lock "cinder-b1639c52-1255-4399-b9a1-42fc66643240-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6edda1e7-e185-4303-982f-89f5550cf57a tempest-GroupsV320Test-2104507477 None] Group tempest-GroupsV320Test-Group-326313801: creating Nov 01 12:25:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6edda1e7-e185-4303-982f-89f5550cf57a tempest-GroupsV320Test-2104507477 None] Group tempest-GroupsV320Test-Group-326313801: created successfully Nov 01 12:25:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6edda1e7-e185-4303-982f-89f5550cf57a tempest-GroupsV320Test-2104507477 None] Create group completed successfully. Nov 01 12:25:29 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-d48e2bfd-1e8d-4d2d-bbe1-82c33b3e5e09 tempest-GroupsV320Test-2104507477 None] Created reservations ['24fdb8c1-05bf-4b10-9917-1132a022f480'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d48e2bfd-1e8d-4d2d-bbe1-82c33b3e5e09 tempest-GroupsV320Test-2104507477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d48e2bfd-1e8d-4d2d-bbe1-82c33b3e5e09 tempest-GroupsV320Test-2104507477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d48e2bfd-1e8d-4d2d-bbe1-82c33b3e5e09 tempest-GroupsV320Test-2104507477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d48e2bfd-1e8d-4d2d-bbe1-82c33b3e5e09 tempest-GroupsV320Test-2104507477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d48e2bfd-1e8d-4d2d-bbe1-82c33b3e5e09 tempest-GroupsV320Test-2104507477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d48e2bfd-1e8d-4d2d-bbe1-82c33b3e5e09 tempest-GroupsV320Test-2104507477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:29 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:25:29 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:29 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d48e2bfd-1e8d-4d2d-bbe1-82c33b3e5e09 tempest-GroupsV320Test-2104507477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.367s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:29 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-d48e2bfd-1e8d-4d2d-bbe1-82c33b3e5e09 tempest-GroupsV320Test-2104507477 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:30 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d48e2bfd-1e8d-4d2d-bbe1-82c33b3e5e09 tempest-GroupsV320Test-2104507477 None] Delete group completed successfully. Nov 01 12:25:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:25:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:37 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:25:37 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:37 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.354s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:25:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:25:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:25:39 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=71,cinder:UPDATE=88,cinder:DELETE=4,cinder:INSERT=30 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:25:39 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=63,cinder:SELECT=49,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:25:42 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Flow 'volume_create_manager' (358feefb-016a-457e-88a6-6dfec8918b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0eedad-458e-4aa2-9d8d-38195813adb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0eedad-458e-4aa2-9d8d-38195813adb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86247040-1985-4a8b-856b-254c2c818a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5fa5f20cd044c3b8277245ad8ba286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:43Z,use_quota=True,user_id='b4a006fb6f9e43eaadf92cc04b67db0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1ef62-c3b8-4c7c-b980-4d6fd6bd1168),volume_type_id=d3c1ef62-c3b8-4c7c-b980-4d6fd6bd1168)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912b4429-60ad-4f58-9f7d-2edcf44ed80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912b4429-60ad-4f58-9f7d-2edcf44ed80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e32c70-07b0-4764-bfdf-e3569783e05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:42 devstack cinder-volume[86812]: DEBUG cinder.image.glance [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Creating Keystone auth plugin from conf {{(pid=86812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:25:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e32c70-07b0-4764-bfdf-e3569783e05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86247040-1985-4a8b-856b-254c2c818a46', 'volume_name': 'volume-86247040-1985-4a8b-856b-254c2c818a46', 'volume_size': 1, 'image_id': '87e16b80-b091-4371-aab2-c13334b5e3d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87e16b80-b091-4371-aab2-c13334b5e3d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48ddecce0907287de9f3ab929f99f32c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a5fa5f20cd044c3b8277245ad8ba286', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4f4b71b479ed7ce96046004ae9f97852d200fbb4a7fa48606c450842d1acd98d54ea62b8ed3a418db6c2d2bcc80f2ee3a1a7e51473797c161b730fc6543f637', 'id': '87e16b80-b091-4371-aab2-c13334b5e3d5', 'created_at': datetime.datetime(2026, 11, 1, 11, 25, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87e16b80-b091-4371-aab2-c13334b5e3d5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e3a511-bb55-459a-a776-32c7b68aed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e3a511-bb55-459a-a776-32c7b68aed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302ec60d-2bc2-4a1e-b504-45a082ee252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:43 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Volume 86247040-1985-4a8b-856b-254c2c818a46: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86247040-1985-4a8b-856b-254c2c818a46', 'volume_size': 1, 'image_id': '87e16b80-b091-4371-aab2-c13334b5e3d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87e16b80-b091-4371-aab2-c13334b5e3d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48ddecce0907287de9f3ab929f99f32c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a5fa5f20cd044c3b8277245ad8ba286', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4f4b71b479ed7ce96046004ae9f97852d200fbb4a7fa48606c450842d1acd98d54ea62b8ed3a418db6c2d2bcc80f2ee3a1a7e51473797c161b730fc6543f637', 'id': '87e16b80-b091-4371-aab2-c13334b5e3d5', 'created_at': datetime.datetime(2026, 11, 1, 11, 25, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87e16b80-b091-4371-aab2-c13334b5e3d5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 01 12:25:43 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Trying to clone 86247040-1985-4a8b-856b-254c2c818a46 from image 87e16b80-b091-4371-aab2-c13334b5e3d5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/87e16b80-b091-4371-aab2-c13334b5e3d5', 'metadata': {}}]). {{(pid=86812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:25:43 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:25:43 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Image download 0.00 MB at 0.00 MB/s Nov 01 12:25:43 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a76afc-c267-45aa-9db2-bf4a63368ef5]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:43 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD Nov 01 12:25:43 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:43 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:44 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD Nov 01 12:25:44 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:44 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:25:44 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Temporary image 87e16b80-b091-4371-aab2-c13334b5e3d5 is fetched for user b4a006fb6f9e43eaadf92cc04b67db0e. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:25:44 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2579d4d-bb70-46bf-906c-1d195e3de4c5]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:44 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD Nov 01 12:25:44 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:45 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:45 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD Nov 01 12:25:45 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:45 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD" returned: 1 in 0.596s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86247040-1985-4a8b-856b-254c2c818a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5fa5f20cd044c3b8277245ad8ba286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:43Z,use_quota=True,user_id='b4a006fb6f9e43eaadf92cc04b67db0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3c1ef62-c3b8-4c7c-b980-4d6fd6bd1168),volume_type_id=d3c1ef62-c3b8-4c7c-b980-4d6fd6bd1168)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Creating volume 86247040-1985-4a8b-856b-254c2c818a46 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:45 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:25:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:45 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 1073741824 Nov 01 12:25:45 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:46 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 1073741824" returned: 0 in 0.599s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:46 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 Nov 01 12:25:46 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:46 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46" returned: 0 in 0.453s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:46 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Attempting download of 87e16b80-b091-4371-aab2-c13334b5e3d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/87e16b80-b091-4371-aab2-c13334b5e3d5', 'metadata': {}}])) to volume 86247040-1985-4a8b-856b-254c2c818a46. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:25:47 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[408c6394-27ce-4943-9a86-c59b2591b0e2]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87e16b80-b091-4371-aab2-c13334b5e3d5_kjc67y1x {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:47 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87e16b80-b091-4371-aab2-c13334b5e3d5_kjc67y1x Nov 01 12:25:47 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:47 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_87e16b80-b091-4371-aab2-c13334b5e3d5_kjc67y1x" returned: 0 in 0.509s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87e16b80-b091-4371-aab2-c13334b5e3d5_kjc67y1x {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:47 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87e16b80-b091-4371-aab2-c13334b5e3d5_kjc67y1x Nov 01 12:25:47 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:47 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87e16b80-b091-4371-aab2-c13334b5e3d5_kjc67y1x" returned: 1 in 0.475s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_87e16b80-b091-4371-aab2-c13334b5e3d5_kjc67y1x' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:25:47 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e067125d-b17c-4222-ba8c-be217713683d]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:48 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD Nov 01 12:25:48 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:48 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:48 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD Nov 01 12:25:48 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:49 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD" returned: 1 in 0.533s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:25:49 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] 87e16b80-b091-4371-aab2-c13334b5e3d5 was raw, converting to qcow2 {{(pid=86812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:25:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:49 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 Nov 01 12:25:49 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:49 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46" returned: 0 in 0.601s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:49 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_87e16b80-b091-4371-aab2-c13334b5e3d5_6a115vlcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:25:49 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 12:25:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:49 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 1G Nov 01 12:25:49 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:50 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 1G" returned: 0 in 0.470s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:50 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Downloaded image 87e16b80-b091-4371-aab2-c13334b5e3d5 ((None, [{'url': 'file:///opt/stack/data/glance/images/87e16b80-b091-4371-aab2-c13334b5e3d5', 'metadata': {}}])) to volume 86247040-1985-4a8b-856b-254c2c818a46 successfully. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:25:50 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Temporary image 87e16b80-b091-4371-aab2-c13334b5e3d5 for user b4a006fb6f9e43eaadf92cc04b67db0e is deleted. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:25:50 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Marking volume 86247040-1985-4a8b-856b-254c2c818a46 as bootable. {{(pid=86812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:25:50 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Copying metadata from image 87e16b80-b091-4371-aab2-c13334b5e3d5 to 86247040-1985-4a8b-856b-254c2c818a46. {{(pid=86812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:25:50 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Creating volume glance metadata for volume 86247040-1985-4a8b-856b-254c2c818a46 backed by image 87e16b80-b091-4371-aab2-c13334b5e3d5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '87e16b80-b091-4371-aab2-c13334b5e3d5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '48ddecce0907287de9f3ab929f99f32c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:25:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (302ec60d-2bc2-4a1e-b504-45a082ee252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86247040-1985-4a8b-856b-254c2c818a46', 'volume_size': 1, 'image_id': '87e16b80-b091-4371-aab2-c13334b5e3d5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/87e16b80-b091-4371-aab2-c13334b5e3d5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '48ddecce0907287de9f3ab929f99f32c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a5fa5f20cd044c3b8277245ad8ba286', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f4f4b71b479ed7ce96046004ae9f97852d200fbb4a7fa48606c450842d1acd98d54ea62b8ed3a418db6c2d2bcc80f2ee3a1a7e51473797c161b730fc6543f637', 'id': '87e16b80-b091-4371-aab2-c13334b5e3d5', 'created_at': datetime.datetime(2026, 11, 1, 11, 25, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 25, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/87e16b80-b091-4371-aab2-c13334b5e3d5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feab063e-dc96-4320-a380-10b5a314d31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:50 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Volume volume-86247040-1985-4a8b-856b-254c2c818a46 (86247040-1985-4a8b-856b-254c2c818a46): created successfully Nov 01 12:25:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feab063e-dc96-4320-a380-10b5a314d31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Flow 'volume_create_manager' (358feefb-016a-457e-88a6-6dfec8918b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-495cd151-0c8a-4b8b-babb-25b58310a712 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Created volume successfully. Nov 01 12:25:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Acquiring lock "cinder-86247040-1985-4a8b-856b-254c2c818a46-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Lock "cinder-86247040-1985-4a8b-856b-254c2c818a46-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Acquiring lock "cinder-quobyte-86247040-1985-4a8b-856b-254c2c818a46" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Lock "cinder-quobyte-86247040-1985-4a8b-856b-254c2c818a46" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:51 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0882e4-f367-47ad-8e92-b43dcea93615]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:51 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 Nov 01 12:25:51 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:51 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46" returned: 0 in 0.417s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:51 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46 Nov 01 12:25:51 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:52 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86247040-1985-4a8b-856b-254c2c818a46" returned: 0 in 0.274s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Lock "cinder-quobyte-86247040-1985-4a8b-856b-254c2c818a46" released by "delete_volume" :: held 0.779s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:52 devstack cinder-volume[86812]: WARNING cinder.quota [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:52 devstack cinder-volume[86812]: WARNING cinder.quota [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Created reservations ['f17de1c1-58d4-44d9-b4c2-67ae2ad82bd8', '3da67c25-52a8-4140-8dc3-4898e3207997', '9f09f4cd-1236-45bf-bd2e-b06537c49cd6', 'a8b5a32c-b42b-42a5-a7bd-25018a8f0334'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:52 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:25:52 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:52 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.438s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:52 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Deleted volume successfully. Nov 01 12:25:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c68d55f2-1a5f-42e3-8f3f-f01c0d44c0d7 tempest-VolumeAndVolumeTypeFromImageTest-2066365584 None] Lock "cinder-86247040-1985-4a8b-856b-254c2c818a46-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (bf2d5955-af2a-444b-9d37-ac158287b7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c540e231-e547-4d5b-846d-5b44d8ff5e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c540e231-e547-4d5b-846d-5b44d8ff5e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-262660462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560bf1f5-6f47-4f52-b943-2692fcc627e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:00Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e566f3e-6696-42ec-b545-ec09698199ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e566f3e-6696-42ec-b545-ec09698199ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe5b1a6-3107-44ec-84fb-dda5003427c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe5b1a6-3107-44ec-84fb-dda5003427c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '560bf1f5-6f47-4f52-b943-2692fcc627e7', 'volume_name': 'volume-560bf1f5-6f47-4f52-b943-2692fcc627e7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800c4cfc-fb6e-404a-8a8d-858571b3f7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800c4cfc-fb6e-404a-8a8d-858571b3f7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98358000-03c6-4259-8e88-5394efae563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:59 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume 560bf1f5-6f47-4f52-b943-2692fcc627e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-560bf1f5-6f47-4f52-b943-2692fcc627e7', 'volume_size': 1} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-262660462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560bf1f5-6f47-4f52-b943-2692fcc627e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:00Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Creating volume 560bf1f5-6f47-4f52-b943-2692fcc627e7 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:59 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:59 devstack sudo[94251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7 1073741824 Nov 01 12:25:59 devstack sudo[94251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:59 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Flow 'volume_create_manager' (46e7785e-d886-4188-9114-8b7871cac2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0b2a1b-91fa-4a74-86a2-ac064027cc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0b2a1b-91fa-4a74-86a2-ac064027cc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-144388087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66aaf56f-fc77-4e19-9509-4d00851ee827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230f81ae54ab430bbd6ac190f2255b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:00Z,use_quota=True,user_id='256ab2c44fad474180ae33a7a084a3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c8f4cc-ed1c-4317-8048-4d8fa5217cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c8f4cc-ed1c-4317-8048-4d8fa5217cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d385f74-7a64-4b3b-bd63-79826b0c23b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d385f74-7a64-4b3b-bd63-79826b0c23b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66aaf56f-fc77-4e19-9509-4d00851ee827', 'volume_name': 'volume-66aaf56f-fc77-4e19-9509-4d00851ee827', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793d2264-40c7-42f7-915a-f463d6e81a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (793d2264-40c7-42f7-915a-f463d6e81a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fda842-2727-432e-a2c2-6d7e48ad4461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:00 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Volume 66aaf56f-fc77-4e19-9509-4d00851ee827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66aaf56f-fc77-4e19-9509-4d00851ee827', 'volume_size': 1} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:00 devstack sudo[94251]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7 1073741824" returned: 0 in 0.487s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:00 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7 Nov 01 12:26:00 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:00 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7" returned: 0 in 0.347s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-144388087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66aaf56f-fc77-4e19-9509-4d00851ee827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230f81ae54ab430bbd6ac190f2255b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:00Z,use_quota=True,user_id='256ab2c44fad474180ae33a7a084a3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Creating volume 66aaf56f-fc77-4e19-9509-4d00851ee827 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:00 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:00 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827 1073741824 Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98358000-03c6-4259-8e88-5394efae563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560bf1f5-6f47-4f52-b943-2692fcc627e7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:00 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b136d9-aa44-4426-82fd-a6b7ac581ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:00 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume volume-560bf1f5-6f47-4f52-b943-2692fcc627e7 (560bf1f5-6f47-4f52-b943-2692fcc627e7): created successfully Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b136d9-aa44-4426-82fd-a6b7ac581ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (bf2d5955-af2a-444b-9d37-ac158287b7e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:00 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-05d9211f-e204-406f-a94d-24af1e76686c tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created volume successfully. Nov 01 12:26:01 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827 1073741824" returned: 0 in 0.621s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:01 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827 Nov 01 12:26:01 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Flow 'volume_create_manager' (6d7a2e4b-3eca-4f47-8cab-2f74ac29b4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd154580-ca10-4d49-b2cb-5d7b91b34f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd154580-ca10-4d49-b2cb-5d7b91b34f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-834187807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af76a90-9bae-4ed6-9af5-b229155ba8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7841b4e5404591a6ed81f8c25fa2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:02Z,use_quota=True,user_id='c184d907136343cd92e8d2a5dd74007f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1defea-9e09-46cc-833f-c80a3e04e579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd1defea-9e09-46cc-833f-c80a3e04e579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2eb7183-ef69-4cef-8651-342ffce67659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2eb7183-ef69-4cef-8651-342ffce67659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af76a90-9bae-4ed6-9af5-b229155ba8b7', 'volume_name': 'volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7db61f-9c7c-4abb-b72a-7dd97985ab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7db61f-9c7c-4abb-b72a-7dd97985ab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d3de65-aef0-4073-8ced-bef274acf7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:01 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Volume 1af76a90-9bae-4ed6-9af5-b229155ba8b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7', 'volume_size': 1} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:01 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-834187807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af76a90-9bae-4ed6-9af5-b229155ba8b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc7841b4e5404591a6ed81f8c25fa2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:02Z,use_quota=True,user_id='c184d907136343cd92e8d2a5dd74007f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Creating volume 1af76a90-9bae-4ed6-9af5-b229155ba8b7 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:01 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:01 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7 1073741824 Nov 01 12:26:01 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fda842-2727-432e-a2c2-6d7e48ad4461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66aaf56f-fc77-4e19-9509-4d00851ee827', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8304a8d1-38fe-45d3-bcc6-4400cad433fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:01 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Volume volume-66aaf56f-fc77-4e19-9509-4d00851ee827 (66aaf56f-fc77-4e19-9509-4d00851ee827): created successfully Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8304a8d1-38fe-45d3-bcc6-4400cad433fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Flow 'volume_create_manager' (46e7785e-d886-4188-9114-8b7871cac2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:01 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f2d11c99-e11e-4b08-950e-40cf830c9661 tempest-AttachVolumeTestJSON-2032413549 None] Created volume successfully. Nov 01 12:26:02 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7 1073741824" returned: 0 in 0.627s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:02 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7 Nov 01 12:26:02 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (f3973da8-a1db-4ba7-a8fb-e16791f28dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d4f98e-e150-41f4-9673-a9fc64a080c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d4f98e-e150-41f4-9673-a9fc64a080c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-793475081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253cddb0-260f-4fae-a3e4-cc91dd211d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:03Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e8bfba-dc3e-4396-8558-03232a3d8cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e8bfba-dc3e-4396-8558-03232a3d8cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2210355f-6433-4e28-8160-b3cc3938b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2210355f-6433-4e28-8160-b3cc3938b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253cddb0-260f-4fae-a3e4-cc91dd211d27', 'volume_name': 'volume-253cddb0-260f-4fae-a3e4-cc91dd211d27', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c713ed62-709a-47db-a798-706443587b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c713ed62-709a-47db-a798-706443587b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974db4b6-6267-40ca-855f-be0460b33ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:02 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume 253cddb0-260f-4fae-a3e4-cc91dd211d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253cddb0-260f-4fae-a3e4-cc91dd211d27', 'volume_size': 1} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:02 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7" returned: 0 in 0.493s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.133s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-793475081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253cddb0-260f-4fae-a3e4-cc91dd211d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:03Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Creating volume 253cddb0-260f-4fae-a3e4-cc91dd211d27 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:02 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:03 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27 1073741824 Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d3de65-aef0-4073-8ced-bef274acf7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb4c52d-9b04-4f6c-b4c7-7a66af3936b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Volume volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7 (1af76a90-9bae-4ed6-9af5-b229155ba8b7): created successfully Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb4c52d-9b04-4f6c-b4c7-7a66af3936b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Flow 'volume_create_manager' (6d7a2e4b-3eca-4f47-8cab-2f74ac29b4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:03 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-457f6e44-70de-4fad-b664-53899f3124eb tempest-VolumeQuotasNegativeTestJSON-602216838 None] Created volume successfully. Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (dd7f164e-379e-4941-8448-a2f31fc91bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397cb134-3c02-42c5-a7a1-109487c36754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397cb134-3c02-42c5-a7a1-109487c36754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556821223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6638a9-772c-4f41-8387-e6105162ef7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:03Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d5106c-ce59-4895-adba-33e685ab9b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d5106c-ce59-4895-adba-33e685ab9b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6494486-6e07-43c7-855c-53c2071080e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6494486-6e07-43c7-855c-53c2071080e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6638a9-772c-4f41-8387-e6105162ef7e', 'volume_name': 'volume-eb6638a9-772c-4f41-8387-e6105162ef7e', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c45961-25f7-45bf-ae91-b25355f87d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c45961-25f7-45bf-ae91-b25355f87d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0789cc20-e99a-43b6-94d0-78cb96e36e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume eb6638a9-772c-4f41-8387-e6105162ef7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6638a9-772c-4f41-8387-e6105162ef7e', 'volume_size': 1} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-0a60549e-f0c0-46fe-bdbf-a509d72bfeb8 req-e1cb1c72-40bd-432d-8c56-bf8cc373bc44 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:03 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (497c32df-bd3d-49f8-bb5c-5c977b1e2731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945c3964-c9b5-4df8-a030-ced632be8f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27 1073741824" returned: 0 in 0.773s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945c3964-c9b5-4df8-a030-ced632be8f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1335778844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9361e05-29b2-43c4-9a38-7edf14c0f901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:04Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2784489-f434-493c-856e-7a3b6c51cab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2784489-f434-493c-856e-7a3b6c51cab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547ae0a3-4146-4966-8114-176fcfa15497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547ae0a3-4146-4966-8114-176fcfa15497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9361e05-29b2-43c4-9a38-7edf14c0f901', 'volume_name': 'volume-e9361e05-29b2-43c4-9a38-7edf14c0f901', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082df634-bd0e-465a-86b1-f38e37d9f6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (082df634-bd0e-465a-86b1-f38e37d9f6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba889cf2-152d-403c-86ad-01819ae2148b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume e9361e05-29b2-43c4-9a38-7edf14c0f901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9361e05-29b2-43c4-9a38-7edf14c0f901', 'volume_size': 1} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:03 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27 Nov 01 12:26:03 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:04 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27" returned: 0 in 0.298s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-556821223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6638a9-772c-4f41-8387-e6105162ef7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:03Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Creating volume eb6638a9-772c-4f41-8387-e6105162ef7e {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:04 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:04 devstack sudo[94302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e 1073741824 Nov 01 12:26:04 devstack sudo[94302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974db4b6-6267-40ca-855f-be0460b33ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253cddb0-260f-4fae-a3e4-cc91dd211d27', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da69f27-325f-4e80-9261-f2fd36ab4c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume volume-253cddb0-260f-4fae-a3e4-cc91dd211d27 (253cddb0-260f-4fae-a3e4-cc91dd211d27): created successfully Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da69f27-325f-4e80-9261-f2fd36ab4c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (f3973da8-a1db-4ba7-a8fb-e16791f28dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (49d347ec-b033-4b56-8012-a9f8a57ca759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c064a88d-34ae-4c20-8395-e71501457abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-531894a0-8106-45b3-9d83-919df6869786 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created volume successfully. Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c064a88d-34ae-4c20-8395-e71501457abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1464347010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284221ae-192a-4949-a7ab-7073775ae845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:04Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8898871c-70e6-489f-b6e6-2a530385ad81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8898871c-70e6-489f-b6e6-2a530385ad81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ab33fa-4877-4063-9d32-537d88979415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ab33fa-4877-4063-9d32-537d88979415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '284221ae-192a-4949-a7ab-7073775ae845', 'volume_name': 'volume-284221ae-192a-4949-a7ab-7073775ae845', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d40af8-3b7d-472f-9958-c7a8a78c4ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d40af8-3b7d-472f-9958-c7a8a78c4ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9918c5fa-7eef-4629-9120-4472a28b9ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume 284221ae-192a-4949-a7ab-7073775ae845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-284221ae-192a-4949-a7ab-7073775ae845', 'volume_size': 1} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (23b97788-052c-4162-b46a-ee2999019ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14906ff6-4cab-45b4-aa4b-fc083dd11135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14906ff6-4cab-45b4-aa4b-fc083dd11135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922954595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8e6e1b-8c28-43e8-b054-4e274d273620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:05Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca622989-879a-40c7-b093-e2e414f48152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca622989-879a-40c7-b093-e2e414f48152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:04 devstack sudo[94302]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e262e76-1d1e-4658-b0fb-466043bedcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e262e76-1d1e-4658-b0fb-466043bedcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8e6e1b-8c28-43e8-b054-4e274d273620', 'volume_name': 'volume-0b8e6e1b-8c28-43e8-b054-4e274d273620', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d911e798-17a3-4e97-9f9f-bc8052c8279d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d911e798-17a3-4e97-9f9f-bc8052c8279d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de29f83d-b7ce-42f6-894e-e85630e0b95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:04 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume 0b8e6e1b-8c28-43e8-b054-4e274d273620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8e6e1b-8c28-43e8-b054-4e274d273620', 'volume_size': 1} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e 1073741824" returned: 0 in 0.581s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:04 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e Nov 01 12:26:04 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e" returned: 0 in 0.267s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:05 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-0a60549e-f0c0-46fe-bdbf-a509d72bfeb8 req-e1cb1c72-40bd-432d-8c56-bf8cc373bc44 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.588s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-0a60549e-f0c0-46fe-bdbf-a509d72bfeb8 req-e1cb1c72-40bd-432d-8c56-bf8cc373bc44 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.258s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1335778844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9361e05-29b2-43c4-9a38-7edf14c0f901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:04Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Creating volume e9361e05-29b2-43c4-9a38-7edf14c0f901 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:05 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0789cc20-e99a-43b6-94d0-78cb96e36e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6638a9-772c-4f41-8387-e6105162ef7e', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f219d22d-2adf-487f-bba7-278ba110f86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:05 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901 1073741824 Nov 01 12:26:05 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:05 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume volume-eb6638a9-772c-4f41-8387-e6105162ef7e (eb6638a9-772c-4f41-8387-e6105162ef7e): created successfully Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f219d22d-2adf-487f-bba7-278ba110f86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (dd7f164e-379e-4941-8448-a2f31fc91bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-0a60549e-f0c0-46fe-bdbf-a509d72bfeb8 req-e1cb1c72-40bd-432d-8c56-bf8cc373bc44 tempest-AttachVolumeTestJSON-2032413549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-66aaf56f-fc77-4e19-9509-4d00851ee827', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc8ce0be-5700-4698-8cd4-e7b4ef09aa79', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:26:05 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-40b92c0d-6576-4766-ad83-2ca6c656d749 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created volume successfully. Nov 01 12:26:05 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-0a60549e-f0c0-46fe-bdbf-a509d72bfeb8 req-e1cb1c72-40bd-432d-8c56-bf8cc373bc44 tempest-AttachVolumeTestJSON-2032413549 None] attachment_update completed successfully. Nov 01 12:26:05 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901 1073741824" returned: 0 in 0.665s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:05 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901 Nov 01 12:26:05 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:06 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901" returned: 0 in 0.338s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.783s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1464347010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=284221ae-192a-4949-a7ab-7073775ae845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:04Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Creating volume 284221ae-192a-4949-a7ab-7073775ae845 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:06 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Acquiring lock "cinder-1af76a90-9bae-4ed6-9af5-b229155ba8b7-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:06 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845 1073741824 Nov 01 12:26:06 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba889cf2-152d-403c-86ad-01819ae2148b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9361e05-29b2-43c4-9a38-7edf14c0f901', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d9fbc4-5682-4773-a5ff-dc234b2e4888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Lock "cinder-1af76a90-9bae-4ed6-9af5-b229155ba8b7-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:06 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume volume-e9361e05-29b2-43c4-9a38-7edf14c0f901 (e9361e05-29b2-43c4-9a38-7edf14c0f901): created successfully Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27d9fbc4-5682-4773-a5ff-dc234b2e4888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (497c32df-bd3d-49f8-bb5c-5c977b1e2731) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:06 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-2decc28b-a449-407e-8e7e-8dd92c5bfe39 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created volume successfully. Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Acquiring lock "cinder-quobyte-1af76a90-9bae-4ed6-9af5-b229155ba8b7" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Lock "cinder-quobyte-1af76a90-9bae-4ed6-9af5-b229155ba8b7" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c781f54-9169-4584-b85a-ee57613141b5]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:06 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7 Nov 01 12:26:06 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:06 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845 1073741824" returned: 0 in 0.610s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:06 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845 Nov 01 12:26:06 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:06 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7" returned: 0 in 0.471s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:06 devstack sudo[94748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7 Nov 01 12:26:06 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:07 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845" returned: 0 in 0.291s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.384s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922954595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8e6e1b-8c28-43e8-b054-4e274d273620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7850c0ea8ef440c9b768045d03dcf2d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:05Z,use_quota=True,user_id='c8aa0efbf6e44e49a40941678642c6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Creating volume 0b8e6e1b-8c28-43e8-b054-4e274d273620 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:07 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:07 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620 1073741824 Nov 01 12:26:07 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9918c5fa-7eef-4629-9120-4472a28b9ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-284221ae-192a-4949-a7ab-7073775ae845', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d022aba-bba5-4664-959d-ea69f44d0d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1af76a90-9bae-4ed6-9af5-b229155ba8b7" returned: 0 in 0.306s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:07 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume volume-284221ae-192a-4949-a7ab-7073775ae845 (284221ae-192a-4949-a7ab-7073775ae845): created successfully Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d022aba-bba5-4664-959d-ea69f44d0d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (49d347ec-b033-4b56-8012-a9f8a57ca759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Lock "cinder-quobyte-1af76a90-9bae-4ed6-9af5-b229155ba8b7" released by "delete_volume" :: held 0.851s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:07 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7fd84519-e3d5-4ca2-8fe1-ddcc5b38eee2 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created volume successfully. Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Created reservations ['f075953b-7132-4c64-aed7-948bafdda2ac', '0459ae33-97aa-4fea-930e-5605ca2894d9', 'ec2d34a8-1569-4192-a23f-965471e3556e', '25d4a882-8ca6-4551-9d4a-88b5b4ce4d4b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:07 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:07 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:07 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.561s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:07 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Deleted volume successfully. Nov 01 12:26:07 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620 1073741824" returned: 0 in 0.840s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-72451df1-49e4-4e87-9c80-217e77a24452 tempest-VolumeQuotasNegativeTestJSON-602216838 None] Lock "cinder-1af76a90-9bae-4ed6-9af5-b229155ba8b7-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:08 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620 Nov 01 12:26:08 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:08 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620" returned: 0 in 0.265s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de29f83d-b7ce-42f6-894e-e85630e0b95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8e6e1b-8c28-43e8-b054-4e274d273620', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd97ada2-b028-4d94-832e-3cffd882f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:08 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Volume volume-0b8e6e1b-8c28-43e8-b054-4e274d273620 (0b8e6e1b-8c28-43e8-b054-4e274d273620): created successfully Nov 01 12:26:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd97ada2-b028-4d94-832e-3cffd882f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Flow 'volume_create_manager' (23b97788-052c-4162-b46a-ee2999019ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:08 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-645e34db-9169-4dda-91ab-62b955009dc6 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created volume successfully. Nov 01 12:26:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-0b8e6e1b-8c28-43e8-b054-4e274d273620-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-0b8e6e1b-8c28-43e8-b054-4e274d273620-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-quobyte-0b8e6e1b-8c28-43e8-b054-4e274d273620" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-0b8e6e1b-8c28-43e8-b054-4e274d273620" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:09 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[382909de-537f-46fc-b8f3-11600efbecbf]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:09 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620 Nov 01 12:26:09 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:09 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620" returned: 0 in 0.488s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:09 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620 Nov 01 12:26:09 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:09 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0b8e6e1b-8c28-43e8-b054-4e274d273620" returned: 0 in 0.323s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-0b8e6e1b-8c28-43e8-b054-4e274d273620" released by "delete_volume" :: held 0.877s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:10 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created reservations ['90575f35-0b9f-4825-a9e6-7f8c4a11f3ea', 'dd0defe5-6f0c-409b-9592-f695040c5130', '46734fa1-72ef-469c-8e18-03fa54ab0a3a', '7381d854-0c1d-4312-83a7-d7cb484abcae'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:10 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:10 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:10 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.335s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:10 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:10 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Deleted volume successfully. Nov 01 12:26:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52587370-58d0-4a2f-8c3a-b60e2b8c016f tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-0b8e6e1b-8c28-43e8-b054-4e274d273620-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-284221ae-192a-4949-a7ab-7073775ae845-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-284221ae-192a-4949-a7ab-7073775ae845-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-quobyte-284221ae-192a-4949-a7ab-7073775ae845" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-284221ae-192a-4949-a7ab-7073775ae845" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:11 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac8004a-6ad0-4adc-9570-d5e34add17e6]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:11 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845 Nov 01 12:26:11 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:12 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845" returned: 0 in 0.627s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:12 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845 Nov 01 12:26:12 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:12 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-284221ae-192a-4949-a7ab-7073775ae845" returned: 0 in 0.452s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-284221ae-192a-4949-a7ab-7073775ae845" released by "delete_volume" :: held 1.178s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created reservations ['3b503d0e-5924-4015-bdba-6138b53dba55', '70f42308-ab80-456f-aab8-515a12a83a23', 'a5dff35b-0675-4b7e-9369-8b7edfdf50ca', '9fec858f-2308-46a2-9d5a-9413622f248c'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:12 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:12 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:13 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.554s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:13 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:13 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Deleted volume successfully. Nov 01 12:26:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a09eaa8-7b25-41f1-96e0-e85562a86e9b tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-284221ae-192a-4949-a7ab-7073775ae845-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-e9361e05-29b2-43c4-9a38-7edf14c0f901-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-e9361e05-29b2-43c4-9a38-7edf14c0f901-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-quobyte-e9361e05-29b2-43c4-9a38-7edf14c0f901" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-e9361e05-29b2-43c4-9a38-7edf14c0f901" acquired by "delete_volume" :: waited 0.043s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:14 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b3875e-cec2-4e19-b6d5-05530a138129]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:14 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901 Nov 01 12:26:14 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:14 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901" returned: 0 in 0.669s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:14 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901 Nov 01 12:26:14 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:15 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e9361e05-29b2-43c4-9a38-7edf14c0f901" returned: 0 in 0.540s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-e9361e05-29b2-43c4-9a38-7edf14c0f901" released by "delete_volume" :: held 1.305s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:15 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created reservations ['50f59de8-1bfe-4bfb-b953-0911e5a40fbf', '851b2bbe-b91a-4991-a6a8-fec405e27cb2', '7408acca-502e-417b-81fb-7e98f73e49ea', '8a97886a-dbb9-40b2-a134-516c6784a7c2'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:15 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:15 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:16 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.578s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:16 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Deleted volume successfully. Nov 01 12:26:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-157b79b2-46f4-45e4-a497-da288e547e41 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-e9361e05-29b2-43c4-9a38-7edf14c0f901-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-eb6638a9-772c-4f41-8387-e6105162ef7e-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-eb6638a9-772c-4f41-8387-e6105162ef7e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-quobyte-eb6638a9-772c-4f41-8387-e6105162ef7e" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-eb6638a9-772c-4f41-8387-e6105162ef7e" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:16 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f0db0-c53e-448b-8d7a-a19f3974c573]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:16 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e Nov 01 12:26:16 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:17 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e" returned: 0 in 0.535s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:17 devstack sudo[95383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e Nov 01 12:26:17 devstack sudo[95383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:17 devstack sudo[95383]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-eb6638a9-772c-4f41-8387-e6105162ef7e" returned: 0 in 0.470s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-eb6638a9-772c-4f41-8387-e6105162ef7e" released by "delete_volume" :: held 1.087s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created reservations ['0b63915d-07be-41ef-92b5-bbed8aec5a5b', 'bd526df7-d4ed-4adf-8f9e-542345462670', 'ffbbeb75-7382-4707-89ea-f327a749c4e7', 'df1613ca-8e6a-4215-9fd2-d39adc205561'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:17 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:17 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:18 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.298s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:18 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Deleted volume successfully. Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52a06df5-0e0d-43ee-acec-3443e6d53bf4 tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-eb6638a9-772c-4f41-8387-e6105162ef7e-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Flow 'volume_create_manager' (ab641ef8-1fb1-4523-8ea2-16891cca725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a043fd92-1b03-43f9-8068-7f0d4506d1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a043fd92-1b03-43f9-8068-7f0d4506d1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1006826761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff86f7f-725c-4ba7-8533-4a129fd1f0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe2902aa1c0485aa2ddd85313819a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:18Z,use_quota=True,user_id='f60df163f5a6460d8535147fbcf094fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1d787f-7691-4961-b9ad-e7c18ca99561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f1d787f-7691-4961-b9ad-e7c18ca99561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c77826-8436-450e-8bb9-57f62e553a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05c77826-8436-450e-8bb9-57f62e553a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff86f7f-725c-4ba7-8533-4a129fd1f0f0', 'volume_name': 'volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce346e4d-9608-4d5f-a291-550f7577fb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce346e4d-9608-4d5f-a291-550f7577fb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21402457-d666-4cad-9f89-1ea792fc1e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:18 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Volume 0ff86f7f-725c-4ba7-8533-4a129fd1f0f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0', 'volume_size': 1} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1006826761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff86f7f-725c-4ba7-8533-4a129fd1f0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe2902aa1c0485aa2ddd85313819a60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:18Z,use_quota=True,user_id='f60df163f5a6460d8535147fbcf094fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Creating volume 0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:18 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:18 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 1073741824 Nov 01 12:26:18 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-253cddb0-260f-4fae-a3e4-cc91dd211d27-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-253cddb0-260f-4fae-a3e4-cc91dd211d27-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-quobyte-253cddb0-260f-4fae-a3e4-cc91dd211d27" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-253cddb0-260f-4fae-a3e4-cc91dd211d27" acquired by "delete_volume" :: waited 0.056s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:19 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[58710c13-2bb8-4b30-833c-498dafc59675]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:19 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27 Nov 01 12:26:19 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:20 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 1073741824" returned: 0 in 1.375s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:20 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 Nov 01 12:26:20 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:20 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27" returned: 0 in 0.986s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:20 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27 Nov 01 12:26:20 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:20 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0" returned: 0 in 0.426s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21402457-d666-4cad-9f89-1ea792fc1e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324d9b72-7baf-4728-ac0d-a5b6f9458b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:20 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Volume volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 (0ff86f7f-725c-4ba7-8533-4a129fd1f0f0): created successfully Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324d9b72-7baf-4728-ac0d-a5b6f9458b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Flow 'volume_create_manager' (ab641ef8-1fb1-4523-8ea2-16891cca725c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:20 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-dbdc9f36-937b-4ec5-9a4a-15b4d6a4afde tempest-VolumesServicesTestJSON-345478638 None] Created volume successfully. Nov 01 12:26:21 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-253cddb0-260f-4fae-a3e4-cc91dd211d27" returned: 0 in 0.635s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-253cddb0-260f-4fae-a3e4-cc91dd211d27" released by "delete_volume" :: held 1.766s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created reservations ['5cf67c15-0e3c-425a-86c3-fac90b79b03a', '56338446-3c74-49ce-812e-40a05743c64a', '424c64b3-aa89-4ccd-ad24-f277dc9fd798', 'b0973c8e-98c7-447f-86ea-6fddbf2fec67'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:21 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:21 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:21 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-560bf1f5-6f47-4f52-b943-2692fcc627e7-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.291s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:21 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Deleted volume successfully. Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-560bf1f5-6f47-4f52-b943-2692fcc627e7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-30b4d5f2-fa6a-47f0-918a-28274d592fdd tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-253cddb0-260f-4fae-a3e4-cc91dd211d27-delete_volume" released by "delete_volume" :: held 2.535s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "cinder-quobyte-560bf1f5-6f47-4f52-b943-2692fcc627e7" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-560bf1f5-6f47-4f52-b943-2692fcc627e7" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ed33f3-a6ad-4e1f-9a8b-ad70825438c8]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:21 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7 Nov 01 12:26:21 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Acquiring lock "cinder-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Lock "cinder-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Acquiring lock "cinder-quobyte-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Lock "cinder-quobyte-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:22 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7202341-21cb-47fa-b07c-858bd25c61cb]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:22 devstack sudo[95482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 Nov 01 12:26:22 devstack sudo[95482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:22 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7" returned: 0 in 0.749s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:22 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7 Nov 01 12:26:22 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:22 devstack sudo[95482]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0" returned: 0 in 0.539s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:22 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0 Nov 01 12:26:22 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:23 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0" returned: 0 in 0.336s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:23 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-560bf1f5-6f47-4f52-b943-2692fcc627e7" returned: 0 in 0.504s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Lock "cinder-quobyte-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0" released by "delete_volume" :: held 0.957s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-quobyte-560bf1f5-6f47-4f52-b943-2692fcc627e7" released by "delete_volume" :: held 1.323s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Created reservations ['84e8ada7-7e43-435d-9786-02bd9a50a1c9', '1d3e5db7-2ccc-4f04-b01c-ba13c25c0df8', 'cffda14d-6fdf-429c-a157-efec1d60ea8f', 'f55c1094-1c81-47e2-971f-c3ea9fc89ca2'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Created reservations ['becf874e-d5b7-48fd-8a4c-ea961f94b488', 'a3716249-0f1c-4933-b584-7cf2a2422897', '9a9715d3-fe22-454f-9db6-d7a54867176b', '42089b57-55b3-4266-a6af-8193b1d832c6'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:23 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:23 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:23 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:23 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:23 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (481dc8f0-4ce9-4acd-a84b-35173d82e55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214d83e1-98ea-45af-b839-8904a94adac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.520s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:23 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Deleted volume successfully. Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (214d83e1-98ea-45af-b839-8904a94adac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-424229089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ac337b-efae-4856-8131-06c9fd8988d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:24Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533a7f51-02f8-4305-aa4f-ec6225d76442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533a7f51-02f8-4305-aa4f-ec6225d76442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663a4a56-7f38-46d3-8624-d0642010d91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663a4a56-7f38-46d3-8624-d0642010d91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ac337b-efae-4856-8131-06c9fd8988d9', 'volume_name': 'volume-75ac337b-efae-4856-8131-06c9fd8988d9', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64566d77-cc26-49b8-9029-5bbf378e4a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64566d77-cc26-49b8-9029-5bbf378e4a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90e06bd-7cfa-466f-856c-235fe4528dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:23 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Volume 75ac337b-efae-4856-8131-06c9fd8988d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ac337b-efae-4856-8131-06c9fd8988d9', 'volume_size': 1} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-424229089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ac337b-efae-4856-8131-06c9fd8988d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:24Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Creating volume 75ac337b-efae-4856-8131-06c9fd8988d9 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:23 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.546s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:23 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Deleted volume successfully. Nov 01 12:26:24 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9 1073741824 Nov 01 12:26:24 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c09a9d81-bfff-4e55-966b-14f0443d714a tempest-CreateVolumesFromSourceVolumeTest-1405071314 None] Lock "cinder-560bf1f5-6f47-4f52-b943-2692fcc627e7-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-262e46e9-9e98-48d3-ae29-23144a471ba7 tempest-VolumesServicesTestJSON-345478638 None] Lock "cinder-0ff86f7f-725c-4ba7-8533-4a129fd1f0f0-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:24 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9 1073741824" returned: 0 in 0.728s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:24 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9 Nov 01 12:26:24 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:25 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9" returned: 0 in 0.321s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90e06bd-7cfa-466f-856c-235fe4528dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ac337b-efae-4856-8131-06c9fd8988d9', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c6d324-25e7-4cef-be45-65829570ba94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Volume volume-75ac337b-efae-4856-8131-06c9fd8988d9 (75ac337b-efae-4856-8131-06c9fd8988d9): created successfully Nov 01 12:26:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c6d324-25e7-4cef-be45-65829570ba94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (481dc8f0-4ce9-4acd-a84b-35173d82e55f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-90789760-1f4b-4260-ad0c-e4e441849f70 tempest-VolumesActionsTest-1335727425 None] Created volume successfully. Nov 01 12:26:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-730c2485-9215-493d-b55e-94d4e55857ee tempest-VolumesActionsTest-1335727425 None] Acquiring lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9" by "attach_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-730c2485-9215-493d-b55e-94d4e55857ee tempest-VolumesActionsTest-1335727425 None] Lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9" acquired by "attach_volume" :: waited 0.034s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:26 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-730c2485-9215-493d-b55e-94d4e55857ee tempest-VolumesActionsTest-1335727425 None] Attaching volume 75ac337b-efae-4856-8131-06c9fd8988d9 to instance 1db29991-f940-40fb-ba0e-68883b2b53aa at mountpoint /dev/vdb on host None. Nov 01 12:26:26 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-730c2485-9215-493d-b55e-94d4e55857ee tempest-VolumesActionsTest-1335727425 None] Attach volume completed successfully. Nov 01 12:26:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-730c2485-9215-493d-b55e-94d4e55857ee tempest-VolumesActionsTest-1335727425 None] Lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9" released by "attach_volume" :: held 0.184s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9f05e544-048e-4d32-9659-aa2c26c4be47 tempest-VolumesActionsTest-1284413400 None] Terminate volume connection completed successfully. Nov 01 12:26:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9f05e544-048e-4d32-9659-aa2c26c4be47 tempest-VolumesActionsTest-1284413400 None] Acquiring lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9-detach_volume" by "detach_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9f05e544-048e-4d32-9659-aa2c26c4be47 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9f05e544-048e-4d32-9659-aa2c26c4be47 tempest-VolumesActionsTest-1284413400 None] Detaching volume 75ac337b-efae-4856-8131-06c9fd8988d9 from instance 1db29991-f940-40fb-ba0e-68883b2b53aa. Nov 01 12:26:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9f05e544-048e-4d32-9659-aa2c26c4be47 tempest-VolumesActionsTest-1284413400 None] Detach volume completed successfully. Nov 01 12:26:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9f05e544-048e-4d32-9659-aa2c26c4be47 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cb394696-23b1-42b6-a275-0bca140a2303 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9-detach_volume" by "detach_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cb394696-23b1-42b6-a275-0bca140a2303 tempest-VolumesActionsTest-1335727425 None] Lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-cb394696-23b1-42b6-a275-0bca140a2303 tempest-VolumesActionsTest-1335727425 None] Volume detach called, but volume not attached. Nov 01 12:26:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cb394696-23b1-42b6-a275-0bca140a2303 tempest-VolumesActionsTest-1335727425 None] Lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "cinder-quobyte-75ac337b-efae-4856-8131-06c9fd8988d9" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Lock "cinder-quobyte-75ac337b-efae-4856-8131-06c9fd8988d9" acquired by "delete_volume" :: waited 0.034s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[022e3d35-ed74-47ea-a523-73e464c0fa00]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:29 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9 Nov 01 12:26:29 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:29 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9" returned: 0 in 0.650s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:29 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9 Nov 01 12:26:29 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:30 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-75ac337b-efae-4856-8131-06c9fd8988d9" returned: 0 in 0.318s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Lock "cinder-quobyte-75ac337b-efae-4856-8131-06c9fd8988d9" released by "delete_volume" :: held 1.072s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Created reservations ['c7a81d97-cac6-44d8-b0ea-d8f08e789463', 'deac0503-c457-48a9-a6e2-e34b5ef81fd0', 'fcf3aaf5-d692-4682-b59e-21126036244c', 'a1b1c92b-bcb5-4372-a249-428df87fd347'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:30 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:30 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:30 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.364s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:30 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Deleted volume successfully. Nov 01 12:26:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9cb2130a-c251-4530-a48d-6ca6899d0d60 tempest-VolumesActionsTest-1335727425 None] Lock "cinder-75ac337b-efae-4856-8131-06c9fd8988d9-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Flow 'volume_create_manager' (0d868600-0394-4ca7-8579-50f6779dc8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ace1cf1-c2e8-4c94-86de-8433ee0ed359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ace1cf1-c2e8-4c94-86de-8433ee0ed359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206799537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9144035-2d1d-4997-bfeb-76572a5cf85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9c1de465924c46aca9703ba0cebb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:31Z,use_quota=True,user_id='dd87874cde12411bbfa9cce4223e488a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249e9f0e-116d-4768-9d81-ac82091e0e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (249e9f0e-116d-4768-9d81-ac82091e0e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8bfe2e-cffa-4edb-b72d-ebd2f9f75d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8bfe2e-cffa-4edb-b72d-ebd2f9f75d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9144035-2d1d-4997-bfeb-76572a5cf85d', 'volume_name': 'volume-d9144035-2d1d-4997-bfeb-76572a5cf85d', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29f9be5-3513-4411-8450-433242ea55cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29f9be5-3513-4411-8450-433242ea55cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baafea97-7bbc-4e27-9c2a-430370f5a2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:31 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Volume d9144035-2d1d-4997-bfeb-76572a5cf85d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9144035-2d1d-4997-bfeb-76572a5cf85d', 'volume_size': 1} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206799537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9144035-2d1d-4997-bfeb-76572a5cf85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9c1de465924c46aca9703ba0cebb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:31Z,use_quota=True,user_id='dd87874cde12411bbfa9cce4223e488a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Creating volume d9144035-2d1d-4997-bfeb-76572a5cf85d {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:31 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:31 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d 1073741824 Nov 01 12:26:31 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:31 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d 1073741824" returned: 0 in 0.664s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:31 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d Nov 01 12:26:31 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:32 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d" returned: 0 in 0.401s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baafea97-7bbc-4e27-9c2a-430370f5a2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9144035-2d1d-4997-bfeb-76572a5cf85d', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13622a3a-a03b-41a6-8c8b-7161b4937432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:32 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Volume volume-d9144035-2d1d-4997-bfeb-76572a5cf85d (d9144035-2d1d-4997-bfeb-76572a5cf85d): created successfully Nov 01 12:26:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13622a3a-a03b-41a6-8c8b-7161b4937432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Flow 'volume_create_manager' (0d868600-0394-4ca7-8579-50f6779dc8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:32 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7e0e1c03-18e7-449e-a975-fa2a9cfaabd7 tempest-ProjectReaderTests-1897178866 None] Created volume successfully. Nov 01 12:26:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Acquiring lock "cinder-d9144035-2d1d-4997-bfeb-76572a5cf85d-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Lock "cinder-d9144035-2d1d-4997-bfeb-76572a5cf85d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Acquiring lock "cinder-quobyte-d9144035-2d1d-4997-bfeb-76572a5cf85d" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Lock "cinder-quobyte-d9144035-2d1d-4997-bfeb-76572a5cf85d" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[526de236-789d-499e-8a27-23a01e8e4bf9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:33 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d Nov 01 12:26:33 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:34 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d" returned: 0 in 0.412s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:34 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d Nov 01 12:26:34 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:34 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d9144035-2d1d-4997-bfeb-76572a5cf85d" returned: 0 in 0.265s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Lock "cinder-quobyte-d9144035-2d1d-4997-bfeb-76572a5cf85d" released by "delete_volume" :: held 0.741s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Created reservations ['acc98efd-4084-434b-bf8b-1ba5ee3158ac', '20d05872-7a45-4371-b0c3-ed7d40170b24', '66879d09-1a14-4737-b4db-04b9c758d43b', 'cc47f4b1-f9c0-4f08-9ded-85408c0d9e70'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:34 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:34 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:34 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.359s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:34 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Deleted volume successfully. Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a8ac73c3-2e9a-44c9-bf1c-85f78599935f tempest-ProjectReaderTests-1897178866 None] Lock "cinder-d9144035-2d1d-4997-bfeb-76572a5cf85d-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (ac83ab77-523d-49ff-9872-2724987f9b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ba3592-b5d8-4042-8ab0-03293a111eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ba3592-b5d8-4042-8ab0-03293a111eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-157677794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f3bbea-bc82-4db3-8623-dc9d5f19b181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:35Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1740ecf4-7d21-450a-bae8-960e3dc374ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1740ecf4-7d21-450a-bae8-960e3dc374ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebd01f3-1bef-478e-8493-6b513d1b2e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebd01f3-1bef-478e-8493-6b513d1b2e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f3bbea-bc82-4db3-8623-dc9d5f19b181', 'volume_name': 'volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d7ce9c-1abb-4f12-bda0-97d7f92af365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d7ce9c-1abb-4f12-bda0-97d7f92af365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de34e1b-62e9-4b87-bf66-ae00ce59fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:35 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Volume 45f3bbea-bc82-4db3-8623-dc9d5f19b181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181', 'volume_size': 1} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-157677794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f3bbea-bc82-4db3-8623-dc9d5f19b181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:35Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Creating volume 45f3bbea-bc82-4db3-8623-dc9d5f19b181 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:35 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:35 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181 1073741824 Nov 01 12:26:35 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Flow 'volume_create_manager' (7a36f628-7093-4a77-a9f2-719f9b21de4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e83085-4ad2-415a-8ecc-609623292da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e83085-4ad2-415a-8ecc-609623292da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-718392301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3faeeef-e9b9-4166-8db0-432394f50a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9c1de465924c46aca9703ba0cebb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:35Z,use_quota=True,user_id='dd87874cde12411bbfa9cce4223e488a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b2fcac-06e1-4ae7-8926-35c97a5181c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b2fcac-06e1-4ae7-8926-35c97a5181c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7a0c9c-48b6-4efd-8fe8-5d5df43a535a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7a0c9c-48b6-4efd-8fe8-5d5df43a535a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3faeeef-e9b9-4166-8db0-432394f50a33', 'volume_name': 'volume-f3faeeef-e9b9-4166-8db0-432394f50a33', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03457d5-0a6a-437d-a403-87fca5b7c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03457d5-0a6a-437d-a403-87fca5b7c510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea3ef034-7c20-4e69-a0a8-4ca81bca84aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:35 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Volume f3faeeef-e9b9-4166-8db0-432394f50a33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3faeeef-e9b9-4166-8db0-432394f50a33', 'volume_size': 1} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:35 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181 1073741824" returned: 0 in 0.508s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:35 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181 Nov 01 12:26:35 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:35 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181" returned: 0 in 0.285s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-718392301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3faeeef-e9b9-4166-8db0-432394f50a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9c1de465924c46aca9703ba0cebb36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:35Z,use_quota=True,user_id='dd87874cde12411bbfa9cce4223e488a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Creating volume f3faeeef-e9b9-4166-8db0-432394f50a33 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:35 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3de34e1b-62e9-4b87-bf66-ae00ce59fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ef248c-2f1c-4b50-aa46-92645cf73463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:35 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33 1073741824 Nov 01 12:26:35 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:35 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Volume volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181 (45f3bbea-bc82-4db3-8623-dc9d5f19b181): created successfully Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ef248c-2f1c-4b50-aa46-92645cf73463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (ac83ab77-523d-49ff-9872-2724987f9b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7940aebf-f65c-4de4-af90-386ef6eac7d4 tempest-VolumesActionsTest-1335727425 None] Created volume successfully. Nov 01 12:26:36 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33 1073741824" returned: 0 in 0.559s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:36 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33 Nov 01 12:26:36 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:36 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33" returned: 0 in 0.300s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea3ef034-7c20-4e69-a0a8-4ca81bca84aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3faeeef-e9b9-4166-8db0-432394f50a33', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d091ae4a-4a75-4409-8bbd-e44c80e0558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:36 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Volume volume-f3faeeef-e9b9-4166-8db0-432394f50a33 (f3faeeef-e9b9-4166-8db0-432394f50a33): created successfully Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d091ae4a-4a75-4409-8bbd-e44c80e0558f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Flow 'volume_create_manager' (7a36f628-7093-4a77-a9f2-719f9b21de4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:36 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4a79eabe-445e-43f4-9ba1-10a68ec4e3d2 tempest-ProjectReaderTests-1897178866 None] Created volume successfully. Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:36 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:36 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Acquiring lock "cinder-45f3bbea-bc82-4db3-8623-dc9d5f19b181-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-45f3bbea-bc82-4db3-8623-dc9d5f19b181-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:37 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.406s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Acquiring lock "cinder-quobyte-45f3bbea-bc82-4db3-8623-dc9d5f19b181" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-quobyte-45f3bbea-bc82-4db3-8623-dc9d5f19b181" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Acquiring lock "cinder-f3faeeef-e9b9-4166-8db0-432394f50a33-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97aab68-ba45-45b7-b374-0b50455dc90e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Lock "cinder-f3faeeef-e9b9-4166-8db0-432394f50a33-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Acquiring lock "cinder-quobyte-f3faeeef-e9b9-4166-8db0-432394f50a33" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Lock "cinder-quobyte-f3faeeef-e9b9-4166-8db0-432394f50a33" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:37 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181 Nov 01 12:26:37 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2d2d43-64e5-4d03-adb6-51192e276191]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:37 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33 Nov 01 12:26:37 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:37 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181" returned: 0 in 0.437s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:37 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181 Nov 01 12:26:37 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:38 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33" returned: 0 in 0.434s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:38 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33 Nov 01 12:26:38 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:38 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-45f3bbea-bc82-4db3-8623-dc9d5f19b181" returned: 0 in 0.276s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-quobyte-45f3bbea-bc82-4db3-8623-dc9d5f19b181" released by "delete_volume" :: held 0.833s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Created reservations ['ba2275e9-4742-42c5-99bb-5af839d3fe38', '6fad8df6-6ec1-4133-a26e-db3960d83184', 'a3adc9cf-52d7-4e3e-9a93-8828b86a93d3', '524d422d-ce7c-4f23-97e3-3b3e696eaa35'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:38 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f3faeeef-e9b9-4166-8db0-432394f50a33" returned: 0 in 0.282s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:38 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:38 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Lock "cinder-quobyte-f3faeeef-e9b9-4166-8db0-432394f50a33" released by "delete_volume" :: held 0.796s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Created reservations ['7e0a164d-62ed-44c0-bca3-ab249ab39ad6', '89c92ac0-c836-4396-b447-f964e4a97a87', '620b1aae-b5f0-42df-9b4e-8f4462cbb8a5', 'ed8fcb9f-6a69-4541-bb7c-70ed7a85a32d'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:38 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:38 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:38 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.340s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:38 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Deleted volume successfully. Nov 01 12:26:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13480b91-3c97-43b2-9f72-94107c70c3c5 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-45f3bbea-bc82-4db3-8623-dc9d5f19b181-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:39 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.405s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Deleted volume successfully. Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf07072e-6e7c-4d32-8ae1-1d69a66c93bc tempest-ProjectReaderTests-1897178866 None] Lock "cinder-f3faeeef-e9b9-4166-8db0-432394f50a33-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (ebc54d2c-76f1-42a7-b9fa-ed6d753fc888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cea2d14-6199-4890-b94d-861b6f15ec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cea2d14-6199-4890-b94d-861b6f15ec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1306811005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd684ca-e173-40c0-abf0-3fb90052db40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:39Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b9c6ce-1dec-4a65-a51f-abb402e43985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b9c6ce-1dec-4a65-a51f-abb402e43985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7421353d-2dfe-4a64-b396-ff745b87d48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7421353d-2dfe-4a64-b396-ff745b87d48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd684ca-e173-40c0-abf0-3fb90052db40', 'volume_name': 'volume-7cd684ca-e173-40c0-abf0-3fb90052db40', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c98ac33-cb07-4c81-9870-2656f74e1c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c98ac33-cb07-4c81-9870-2656f74e1c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb88e78-7cf6-47bb-a138-dd2f83c0268a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:39 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Volume 7cd684ca-e173-40c0-abf0-3fb90052db40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd684ca-e173-40c0-abf0-3fb90052db40', 'volume_size': 1} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1306811005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd684ca-e173-40c0-abf0-3fb90052db40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:39Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Creating volume 7cd684ca-e173-40c0-abf0-3fb90052db40 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:39 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:39 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40 1073741824 Nov 01 12:26:39 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:39 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40 1073741824" returned: 0 in 0.517s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=125,cinder:INSERT=37,cinder:UPDATE=147,cinder:DELETE=21 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=160,cinder:SELECT=104,cinder:INSERT=41,cinder:DELETE=6 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:26:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:39 devstack sudo[95652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40 Nov 01 12:26:39 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:40 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40" returned: 0 in 0.308s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb88e78-7cf6-47bb-a138-dd2f83c0268a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd684ca-e173-40c0-abf0-3fb90052db40', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdcc97e-a06f-4ea7-af88-a0b067fc8a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:40 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Volume volume-7cd684ca-e173-40c0-abf0-3fb90052db40 (7cd684ca-e173-40c0-abf0-3fb90052db40): created successfully Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdcc97e-a06f-4ea7-af88-a0b067fc8a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (ebc54d2c-76f1-42a7-b9fa-ed6d753fc888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:40 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-45daa44e-ae71-4582-a954-2b9dff5c4ab7 tempest-VolumesActionsTest-1335727425 None] Created volume successfully. Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Flow 'volume_create_manager' (10fe59c6-6965-4a9d-a438-acf898be16d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a974042a-88fb-4db5-b4f3-45c18f51a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a974042a-88fb-4db5-b4f3-45c18f51a94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1253431448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86fbc6af-ce9a-48b1-9530-1cf903f2b5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7682d73ac3db4d4cbca27bc0f0aa0f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:41Z,use_quota=True,user_id='1537225b09c84a03b6b824337ab12863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c8358d-180c-4af0-91eb-645e6b40ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c8358d-180c-4af0-91eb-645e6b40ac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95261d0-24e9-42da-8bb2-e5a05b2c8bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95261d0-24e9-42da-8bb2-e5a05b2c8bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86fbc6af-ce9a-48b1-9530-1cf903f2b5da', 'volume_name': 'volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0ed124-437a-4c1b-ac05-8d3ebf55206f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf0ed124-437a-4c1b-ac05-8d3ebf55206f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78dee799-b858-456b-9512-43dddf0d079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:40 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Volume 86fbc6af-ce9a-48b1-9530-1cf903f2b5da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da', 'volume_size': 1} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1253431448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86fbc6af-ce9a-48b1-9530-1cf903f2b5da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7682d73ac3db4d4cbca27bc0f0aa0f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:41Z,use_quota=True,user_id='1537225b09c84a03b6b824337ab12863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Creating volume 86fbc6af-ce9a-48b1-9530-1cf903f2b5da {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:40 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:41 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da 1073741824 Nov 01 12:26:41 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Acquiring lock "cinder-7cd684ca-e173-40c0-abf0-3fb90052db40-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Lock "cinder-7cd684ca-e173-40c0-abf0-3fb90052db40-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Acquiring lock "cinder-quobyte-7cd684ca-e173-40c0-abf0-3fb90052db40" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Lock "cinder-quobyte-7cd684ca-e173-40c0-abf0-3fb90052db40" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29053bb-4afa-465e-9eae-7ef3fdbc8431]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:41 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da 1073741824" returned: 0 in 0.564s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:41 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da Nov 01 12:26:41 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:41 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40 Nov 01 12:26:41 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:41 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da" returned: 0 in 0.319s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78dee799-b858-456b-9512-43dddf0d079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c0dc36-a52f-456f-8dcc-3c010cc1d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:41 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Volume volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da (86fbc6af-ce9a-48b1-9530-1cf903f2b5da): created successfully Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c0dc36-a52f-456f-8dcc-3c010cc1d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Flow 'volume_create_manager' (10fe59c6-6965-4a9d-a438-acf898be16d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:41 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-dbf290ec-ff2d-48e8-b300-28231fd5b6ac tempest-VolumesListAdminTestJSON-353671840 None] Created volume successfully. Nov 01 12:26:42 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40" returned: 0 in 0.502s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:42 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40 Nov 01 12:26:42 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:42 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7cd684ca-e173-40c0-abf0-3fb90052db40" returned: 0 in 0.258s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Lock "cinder-quobyte-7cd684ca-e173-40c0-abf0-3fb90052db40" released by "delete_volume" :: held 0.817s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Created reservations ['b24e1585-4845-465a-ae4e-a416d194939d', '9f30c63d-3d82-420d-bd26-4c66d2a26fe1', '70c93d6c-e552-43f7-9b43-59dbe9d4c135', 'e7e7c67c-04dc-438c-a470-3dda0d400c79'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:42 devstack sudo[95673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:42 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:42 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.291s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Deleted volume successfully. Nov 01 12:26:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa146410-38b3-4255-bf1e-18a42509d6ce tempest-VolumesActionsTest-1284413400 None] Lock "cinder-7cd684ca-e173-40c0-abf0-3fb90052db40-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (64e78425-7743-4318-ac3f-0f1eddf3045b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a0f69c-65f2-490e-883a-70dbc01afe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a0f69c-65f2-490e-883a-70dbc01afe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1687587168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2361816-cf83-44f3-aeb1-7a5a85c28294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:43Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9652dc93-6a0e-471b-a14f-828cf24eb40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9652dc93-6a0e-471b-a14f-828cf24eb40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3091fe8-a346-4e55-8650-52064c2b4086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3091fe8-a346-4e55-8650-52064c2b4086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2361816-cf83-44f3-aeb1-7a5a85c28294', 'volume_name': 'volume-b2361816-cf83-44f3-aeb1-7a5a85c28294', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e880a8d1-83cc-4287-b3e9-e13f7e345c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e880a8d1-83cc-4287-b3e9-e13f7e345c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4faa2a-b4f6-40ed-8c82-fe0cb1fd62d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:43 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Volume b2361816-cf83-44f3-aeb1-7a5a85c28294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2361816-cf83-44f3-aeb1-7a5a85c28294', 'volume_size': 1} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1687587168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2361816-cf83-44f3-aeb1-7a5a85c28294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:43Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Creating volume b2361816-cf83-44f3-aeb1-7a5a85c28294 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:43 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:43 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294 1073741824 Nov 01 12:26:43 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Flow 'volume_create_manager' (d1fbbaab-9790-449a-9686-0b6d78ab4a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608a8c02-0adb-4f3e-9363-a9e17625dfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608a8c02-0adb-4f3e-9363-a9e17625dfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1034161609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b062b167-faf9-4258-a9bc-73410f6f50d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7682d73ac3db4d4cbca27bc0f0aa0f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:44Z,use_quota=True,user_id='1537225b09c84a03b6b824337ab12863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e388e42a-b586-4c1f-a75a-8968c1df5160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e388e42a-b586-4c1f-a75a-8968c1df5160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fdf6b0-fefc-4d5a-9211-f6834f769b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64fdf6b0-fefc-4d5a-9211-f6834f769b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b062b167-faf9-4258-a9bc-73410f6f50d5', 'volume_name': 'volume-b062b167-faf9-4258-a9bc-73410f6f50d5', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3ab89f-8f9c-46ca-82ab-377414a12d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3ab89f-8f9c-46ca-82ab-377414a12d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d125954e-f729-4ccf-baa7-a36b910877d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:43 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Volume b062b167-faf9-4258-a9bc-73410f6f50d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b062b167-faf9-4258-a9bc-73410f6f50d5', 'volume_size': 1} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:43 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294 1073741824" returned: 0 in 0.541s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:43 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294 Nov 01 12:26:43 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:44 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294" returned: 0 in 0.258s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1034161609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b062b167-faf9-4258-a9bc-73410f6f50d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7682d73ac3db4d4cbca27bc0f0aa0f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:44Z,use_quota=True,user_id='1537225b09c84a03b6b824337ab12863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Creating volume b062b167-faf9-4258-a9bc-73410f6f50d5 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:44 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff4faa2a-b4f6-40ed-8c82-fe0cb1fd62d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2361816-cf83-44f3-aeb1-7a5a85c28294', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6f3792-0786-4540-9d78-79ce74f4976a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:44 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5 1073741824 Nov 01 12:26:44 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:44 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Volume volume-b2361816-cf83-44f3-aeb1-7a5a85c28294 (b2361816-cf83-44f3-aeb1-7a5a85c28294): created successfully Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6f3792-0786-4540-9d78-79ce74f4976a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (64e78425-7743-4318-ac3f-0f1eddf3045b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:44 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-cf0f9489-c9e1-485f-ae15-2cd9f7cc85d3 tempest-VolumesActionsTest-1335727425 None] Created volume successfully. Nov 01 12:26:44 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5 1073741824" returned: 0 in 0.461s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:44 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5 Nov 01 12:26:44 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:44 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5" returned: 0 in 0.263s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d125954e-f729-4ccf-baa7-a36b910877d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b062b167-faf9-4258-a9bc-73410f6f50d5', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e16804d-72b4-40f1-9243-678d96523c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:44 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Volume volume-b062b167-faf9-4258-a9bc-73410f6f50d5 (b062b167-faf9-4258-a9bc-73410f6f50d5): created successfully Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e16804d-72b4-40f1-9243-678d96523c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Flow 'volume_create_manager' (d1fbbaab-9790-449a-9686-0b6d78ab4a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:44 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5fc2d149-6c70-4dc4-8503-49572fe17070 tempest-VolumesListAdminTestJSON-353671840 None] Created volume successfully. Nov 01 12:26:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Acquiring lock "cinder-b2361816-cf83-44f3-aeb1-7a5a85c28294-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-b2361816-cf83-44f3-aeb1-7a5a85c28294-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Acquiring lock "cinder-quobyte-b2361816-cf83-44f3-aeb1-7a5a85c28294" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-quobyte-b2361816-cf83-44f3-aeb1-7a5a85c28294" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:45 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81e9dab-cdb0-45e2-a439-87d969ef3d91]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:45 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294 Nov 01 12:26:45 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:46 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294" returned: 0 in 0.464s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:46 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294 Nov 01 12:26:46 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:46 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b2361816-cf83-44f3-aeb1-7a5a85c28294" returned: 0 in 0.282s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-quobyte-b2361816-cf83-44f3-aeb1-7a5a85c28294" released by "delete_volume" :: held 0.798s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Flow 'volume_create_manager' (15449113-b649-410d-a1ab-cc134975b7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1365cf3-a42e-40d2-a0d3-8ad418c2e112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1365cf3-a42e-40d2-a0d3-8ad418c2e112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-518795802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9af87f-cfa5-4b94-befb-d1f2d28d305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7682d73ac3db4d4cbca27bc0f0aa0f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:46Z,use_quota=True,user_id='1537225b09c84a03b6b824337ab12863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e17832-5e70-40a6-8445-0a5d9a155aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e17832-5e70-40a6-8445-0a5d9a155aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1230aee3-07bc-42e9-82ba-4112f3c19880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1230aee3-07bc-42e9-82ba-4112f3c19880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d9af87f-cfa5-4b94-befb-d1f2d28d305c', 'volume_name': 'volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aff4146-5983-4e2d-9639-5e28778c0761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aff4146-5983-4e2d-9639-5e28778c0761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fda1f1a-04b6-49a4-aa86-41ad5f67ec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:46 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Volume 6d9af87f-cfa5-4b94-befb-d1f2d28d305c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c', 'volume_size': 1} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-518795802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d9af87f-cfa5-4b94-befb-d1f2d28d305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7682d73ac3db4d4cbca27bc0f0aa0f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:46Z,use_quota=True,user_id='1537225b09c84a03b6b824337ab12863',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Creating volume 6d9af87f-cfa5-4b94-befb-d1f2d28d305c {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:46 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:46 devstack sudo[95713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c 1073741824 Nov 01 12:26:46 devstack sudo[95713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Created reservations ['e043dcad-79b7-438e-87e1-63a53c9de7e3', '68b0ac40-3817-4bd4-96c1-09880f111a13', '57346d9c-9d90-43be-9984-c052e9eb405d', '59a03e66-8068-41d1-a08b-fd19ed123760'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:46 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:46 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:46 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.361s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Deleted volume successfully. Nov 01 12:26:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-92cb65f0-16ba-48e0-86b1-a97735ffce28 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-b2361816-cf83-44f3-aeb1-7a5a85c28294-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:47 devstack sudo[95713]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c 1073741824" returned: 0 in 0.693s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:47 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c Nov 01 12:26:47 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (e98b0681-a37f-4188-88f0-b3191f84d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac93f66a-4b70-4841-ad9d-18003fdcbf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac93f66a-4b70-4841-ad9d-18003fdcbf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-818701097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d7fc91-e457-41fa-9633-01edc07aa35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:47Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd0ebdb-f1c6-4255-965f-504de3c06ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bd0ebdb-f1c6-4255-965f-504de3c06ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0900af94-e4e0-44f6-9939-f9e05d6247ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0900af94-e4e0-44f6-9939-f9e05d6247ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d7fc91-e457-41fa-9633-01edc07aa35f', 'volume_name': 'volume-42d7fc91-e457-41fa-9633-01edc07aa35f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4470635c-7ced-4d89-955e-8dc0c1819a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4470635c-7ced-4d89-955e-8dc0c1819a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576ad79b-9a83-4601-924a-d68cef17f7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:47 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Volume 42d7fc91-e457-41fa-9633-01edc07aa35f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d7fc91-e457-41fa-9633-01edc07aa35f', 'volume_size': 1} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:47 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c" returned: 0 in 0.351s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-818701097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d7fc91-e457-41fa-9633-01edc07aa35f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:47Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Creating volume 42d7fc91-e457-41fa-9633-01edc07aa35f {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:47 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fda1f1a-04b6-49a4-aa86-41ad5f67ec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:47 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f 1073741824 Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bdc087-34e0-4463-bee5-a19b73ff91e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:47 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:47 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Volume volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c (6d9af87f-cfa5-4b94-befb-d1f2d28d305c): created successfully Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bdc087-34e0-4463-bee5-a19b73ff91e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Flow 'volume_create_manager' (15449113-b649-410d-a1ab-cc134975b7ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:47 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0b21e6fc-98d3-4ec4-915a-577f09b3250a tempest-VolumesListAdminTestJSON-353671840 None] Created volume successfully. Nov 01 12:26:48 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f 1073741824" returned: 0 in 0.474s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:48 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f Nov 01 12:26:48 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:48 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f" returned: 0 in 0.261s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576ad79b-9a83-4601-924a-d68cef17f7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d7fc91-e457-41fa-9633-01edc07aa35f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79d6a9d-cca3-4f88-b1ec-f4ce287c1b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:48 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Volume volume-42d7fc91-e457-41fa-9633-01edc07aa35f (42d7fc91-e457-41fa-9633-01edc07aa35f): created successfully Nov 01 12:26:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79d6a9d-cca3-4f88-b1ec-f4ce287c1b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (e98b0681-a37f-4188-88f0-b3191f84d924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-28a58f6e-7b70-49b6-9842-0f5906e938ab tempest-VolumesActionsTest-1335727425 None] Created volume successfully. Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Flow 'volume_create_manager' (6ef09f79-b5d8-43be-8236-fbbb47d6252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7256ab30-e1ec-4245-8a9e-8840e7ccf595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7256ab30-e1ec-4245-8a9e-8840e7ccf595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33602783-1ad0-4c0b-acbc-6ea1dc4fb754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6a6bac6c344fc592107b50434903a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:49Z,use_quota=True,user_id='9261fa2a06e4498c90311c35b4c89157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57aa2a77-53a2-4a51-8044-993c6a036375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57aa2a77-53a2-4a51-8044-993c6a036375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34723b1-29d8-4f90-bfca-85389d2660e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34723b1-29d8-4f90-bfca-85389d2660e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33602783-1ad0-4c0b-acbc-6ea1dc4fb754', 'volume_name': 'volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c9c3a9-3c4d-4ee9-ae7a-e6ae3d26a44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c9c3a9-3c4d-4ee9-ae7a-e6ae3d26a44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef941622-56e5-453c-a263-7093864d0ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:49 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Volume 33602783-1ad0-4c0b-acbc-6ea1dc4fb754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754', 'volume_size': 1} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33602783-1ad0-4c0b-acbc-6ea1dc4fb754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d6a6bac6c344fc592107b50434903a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:49Z,use_quota=True,user_id='9261fa2a06e4498c90311c35b4c89157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Creating volume 33602783-1ad0-4c0b-acbc-6ea1dc4fb754 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:49 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:49 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754 1073741824 Nov 01 12:26:49 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Acquiring lock "cinder-42d7fc91-e457-41fa-9633-01edc07aa35f-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-42d7fc91-e457-41fa-9633-01edc07aa35f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Acquiring lock "cinder-quobyte-42d7fc91-e457-41fa-9633-01edc07aa35f" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-quobyte-42d7fc91-e457-41fa-9633-01edc07aa35f" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7841a4e5-30ed-4e84-a779-5b2421c75f89]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:49 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754 1073741824" returned: 0 in 0.552s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:49 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754 Nov 01 12:26:49 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:49 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f Nov 01 12:26:49 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:50 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754" returned: 0 in 0.266s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef941622-56e5-453c-a263-7093864d0ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a5757c-1edb-48c7-8347-76b751f740a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:50 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Volume volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754 (33602783-1ad0-4c0b-acbc-6ea1dc4fb754): created successfully Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2a5757c-1edb-48c7-8347-76b751f740a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Flow 'volume_create_manager' (6ef09f79-b5d8-43be-8236-fbbb47d6252d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-2fd0461f-3cab-4715-8ae3-42f4347621c9 tempest-VolumesListAdminTestJSON-830345650 None] Created volume successfully. Nov 01 12:26:50 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f" returned: 0 in 0.405s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:50 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f Nov 01 12:26:50 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:50 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-42d7fc91-e457-41fa-9633-01edc07aa35f" returned: 0 in 0.286s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-quobyte-42d7fc91-e457-41fa-9633-01edc07aa35f" released by "delete_volume" :: held 0.740s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Created reservations ['5631b933-925d-45c1-a133-0771c77399ac', '3d618dde-a920-46d2-82a0-3210db62ffe0', '7863a947-92aa-47a5-8724-3435ec50b3fb', '1eed5503-fb7b-4e80-aa4e-199fb2b421e7'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:50 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:50 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:51 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.265s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:51 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Deleted volume successfully. Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4a5e3979-aeb6-4a0c-8a97-e056b05e7962 tempest-VolumesActionsTest-1284413400 None] Lock "cinder-42d7fc91-e457-41fa-9633-01edc07aa35f-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Acquiring lock "cinder-33602783-1ad0-4c0b-acbc-6ea1dc4fb754-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Lock "cinder-33602783-1ad0-4c0b-acbc-6ea1dc4fb754-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Acquiring lock "cinder-quobyte-33602783-1ad0-4c0b-acbc-6ea1dc4fb754" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Lock "cinder-quobyte-33602783-1ad0-4c0b-acbc-6ea1dc4fb754" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (7db31a7e-048d-42fe-a3d1-31bfe54c5445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066abb31-81fa-4bfe-a3b0-24d3636bc0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b55b7d7-5fa1-4078-a382-e3a3d1510cfa]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "cinder-6d9af87f-cfa5-4b94-befb-d1f2d28d305c-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066abb31-81fa-4bfe-a3b0-24d3636bc0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1183362389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034c1c30-d6f1-4b5c-9198-8940d88f6b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:51Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d269a4-223a-4eda-a19f-81860630dd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d269a4-223a-4eda-a19f-81860630dd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b997e2d1-7fb6-443e-b1bf-50a42d24b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b997e2d1-7fb6-443e-b1bf-50a42d24b167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '034c1c30-d6f1-4b5c-9198-8940d88f6b44', 'volume_name': 'volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25f4bef-66c7-42c3-ac0d-507b4ec56fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25f4bef-66c7-42c3-ac0d-507b4ec56fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3289205-7b03-4567-8826-942c78745274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:51 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Volume 034c1c30-d6f1-4b5c-9198-8940d88f6b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44', 'volume_size': 1} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1183362389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=034c1c30-d6f1-4b5c-9198-8940d88f6b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90e8d9f476645ce846c3da361736314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:51Z,use_quota=True,user_id='18cb28557b714f9fba6b9e3173fd77c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Creating volume 034c1c30-d6f1-4b5c-9198-8940d88f6b44 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:51 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-6d9af87f-cfa5-4b94-befb-d1f2d28d305c-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:51 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44 1073741824 Nov 01 12:26:51 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:51 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754 Nov 01 12:26:51 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "cinder-quobyte-6d9af87f-cfa5-4b94-befb-d1f2d28d305c" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-quobyte-6d9af87f-cfa5-4b94-befb-d1f2d28d305c" acquired by "delete_volume" :: waited 0.037s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c424cf65-f69e-424d-8fb6-a24a85b57880]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:52 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c Nov 01 12:26:52 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:52 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754" returned: 0 in 0.668s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:52 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754 Nov 01 12:26:52 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:52 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c" returned: 0 in 0.668s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:52 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44 1073741824" returned: 0 in 0.865s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:52 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c Nov 01 12:26:52 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:52 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-33602783-1ad0-4c0b-acbc-6ea1dc4fb754" returned: 0 in 0.376s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Lock "cinder-quobyte-33602783-1ad0-4c0b-acbc-6ea1dc4fb754" released by "delete_volume" :: held 1.158s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:52 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44 Nov 01 12:26:52 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Created reservations ['d805102a-73dd-4630-a6a3-36c1937b1fc6', '67d0c2b6-36bd-4aaa-bf2b-ebaaef080fae', 'af892053-990b-4842-9e91-41fafd6fe011', 'eda811aa-d006-4b69-a8d5-45c937f6e506'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:52 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:52 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:53 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6d9af87f-cfa5-4b94-befb-d1f2d28d305c" returned: 0 in 0.524s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-quobyte-6d9af87f-cfa5-4b94-befb-d1f2d28d305c" released by "delete_volume" :: held 1.289s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:53 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44" returned: 0 in 0.449s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3289205-7b03-4567-8826-942c78745274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc5bb26-0570-42a3-9fec-d128f9244cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:53 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Volume volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44 (034c1c30-d6f1-4b5c-9198-8940d88f6b44): created successfully Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc5bb26-0570-42a3-9fec-d128f9244cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Flow 'volume_create_manager' (7db31a7e-048d-42fe-a3d1-31bfe54c5445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:53 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.352s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:53 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-06b63838-5d11-49d5-923a-7df27cd65147 tempest-VolumesActionsTest-1335727425 None] Created volume successfully. Nov 01 12:26:53 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Deleted volume successfully. Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Created reservations ['e1530d0e-48ae-4003-9ca0-30cccb48197c', '9704b395-5839-447a-9f23-a3b3c5d75fe4', '2fa704b2-9f7d-424a-a6ea-a2e6c27c9fda', 'efc564ea-dd20-45e2-8db3-a903ee832f4c'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3bcda452-9d1a-4658-b274-19a379298a53 tempest-VolumesListAdminTestJSON-830345650 None] Lock "cinder-33602783-1ad0-4c0b-acbc-6ea1dc4fb754-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:53 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:53 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:53 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-7295e1dc-e9b6-4234-8f39-c707f234cb6b req-f57ca710-d20e-4961-b969-c8d2f94a08d4 tempest-AttachVolumeTestJSON-2032413549 None] Terminate volume connection completed successfully. Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-7295e1dc-e9b6-4234-8f39-c707f234cb6b req-f57ca710-d20e-4961-b969-c8d2f94a08d4 tempest-AttachVolumeTestJSON-2032413549 None] Deleting attachment bc8ce0be-5700-4698-8cd4-e7b4ef09aa79. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:26:53 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.307s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:53 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Deleted volume successfully. Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76a1f4e5-c50c-453e-a34c-a973fc4f3ab8 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-6d9af87f-cfa5-4b94-befb-d1f2d28d305c-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "cinder-b062b167-faf9-4258-a9bc-73410f6f50d5-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-b062b167-faf9-4258-a9bc-73410f6f50d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "cinder-quobyte-b062b167-faf9-4258-a9bc-73410f6f50d5" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-quobyte-b062b167-faf9-4258-a9bc-73410f6f50d5" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[14283912-6ca9-4343-a120-1e3f567cc87b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:54 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5 Nov 01 12:26:54 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "cinder-034c1c30-d6f1-4b5c-9198-8940d88f6b44-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Lock "cinder-034c1c30-d6f1-4b5c-9198-8940d88f6b44-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "cinder-quobyte-034c1c30-d6f1-4b5c-9198-8940d88f6b44" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Lock "cinder-quobyte-034c1c30-d6f1-4b5c-9198-8940d88f6b44" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3b4c0c-8d9f-4f2f-b1ec-a1316b64cba9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:54 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5" returned: 0 in 0.550s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:54 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5 Nov 01 12:26:54 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:54 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44 Nov 01 12:26:54 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:55 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b062b167-faf9-4258-a9bc-73410f6f50d5" returned: 0 in 0.380s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-quobyte-b062b167-faf9-4258-a9bc-73410f6f50d5" released by "delete_volume" :: held 1.008s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Created reservations ['9131d9c0-283b-4897-81b0-c127ba054f7c', '16d3b41e-3dbc-4caa-b777-46fcf3f0e297', '8dab52f9-bbe7-4503-9d8c-9a25e0418386', 'd3759ee4-cb43-47bd-8ed5-b382b79184bd'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:55 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44" returned: 0 in 0.621s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:55 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44 Nov 01 12:26:55 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:55 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:55 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:55 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-034c1c30-d6f1-4b5c-9198-8940d88f6b44" returned: 0 in 0.314s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Lock "cinder-quobyte-034c1c30-d6f1-4b5c-9198-8940d88f6b44" released by "delete_volume" :: held 1.023s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:55 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.312s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:55 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Deleted volume successfully. Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Created reservations ['356386f8-ae29-4979-92f7-1b2309444920', '37cf0791-4ab5-4362-84ae-a41f4f95eb95', '12c4cc94-842e-4bd6-a167-4eb69dae116e', 'ada98671-a0dc-4efd-a7b2-4bab96e67406'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cab732b5-2db7-412e-9fdb-89f9a2db5010 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-b062b167-faf9-4258-a9bc-73410f6f50d5-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:55 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:55 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:55 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:55 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:55 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Deleted volume successfully. Nov 01 12:26:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5fc80e7e-9eba-4a8a-9435-5921a1482275 tempest-VolumesActionsTest-1335727425 None] Lock "cinder-034c1c30-d6f1-4b5c-9198-8940d88f6b44-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "cinder-86fbc6af-ce9a-48b1-9530-1cf903f2b5da-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-86fbc6af-ce9a-48b1-9530-1cf903f2b5da-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "cinder-quobyte-86fbc6af-ce9a-48b1-9530-1cf903f2b5da" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-quobyte-86fbc6af-ce9a-48b1-9530-1cf903f2b5da" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:56 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[064789a4-c1c7-4e3b-a3aa-4a78e3517c95]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:56 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da Nov 01 12:26:56 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:56 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da" returned: 0 in 0.465s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:57 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da Nov 01 12:26:57 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:57 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-86fbc6af-ce9a-48b1-9530-1cf903f2b5da" returned: 0 in 0.283s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-quobyte-86fbc6af-ce9a-48b1-9530-1cf903f2b5da" released by "delete_volume" :: held 0.813s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Created reservations ['c91670ac-ebea-4e79-b436-eb86da31a106', '40d2ec50-40af-4c84-b6fc-2f7954daacaa', '2db0f362-fba1-449c-8777-7ccdec46983f', 'ad24b697-7ba7-4db2-bbfd-0ae530cfbea4'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:57 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:26:57 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:57 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.449s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:57 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:58 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Deleted volume successfully. Nov 01 12:26:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6e345503-39f6-40d9-b717-a1366e456b36 tempest-VolumesListAdminTestJSON-353671840 None] Lock "cinder-86fbc6af-ce9a-48b1-9530-1cf903f2b5da-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Flow 'volume_create_manager' (0cb753bd-7477-4755-ac66-6e9129e63c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad348606-0e80-48e3-953f-12803d3eb9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad348606-0e80-48e3-953f-12803d3eb9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-761843902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d555df1c-b173-4653-b5d1-cdf8a8ad619e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fe6e3adbe04124a53656647b049f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:07Z,use_quota=True,user_id='96cc7dcb28544e39a7a7d905d997e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2501c929-d6a9-4f84-9e79-a8d830b712c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2501c929-d6a9-4f84-9e79-a8d830b712c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed625a2d-f7c6-4517-96d2-cdaff41888a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.image.glance [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Creating Keystone auth plugin from conf {{(pid=86812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed625a2d-f7c6-4517-96d2-cdaff41888a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd555df1c-b173-4653-b5d1-cdf8a8ad619e', 'volume_name': 'volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edce864-af12-4080-ac01-7f2fdba6df42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4edce864-af12-4080-ac01-7f2fdba6df42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c37a61-39c5-4072-9b74-6aa28197399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:07 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Volume d555df1c-b173-4653-b5d1-cdf8a8ad619e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 12:27:07 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Trying to clone d555df1c-b173-4653-b5d1-cdf8a8ad619e from image c5fdc172-8826-4b34-a68d-2114e120626b at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]). {{(pid=86812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:27:08 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:27:08 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Image download 20.69 MB at 20.69 MB/s Nov 01 12:27:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a11c5f-104f-4929-8ded-0493b18ab748]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:08 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD Nov 01 12:27:08 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:08 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:08 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Temporary image c5fdc172-8826-4b34-a68d-2114e120626b is fetched for user 96cc7dcb28544e39a7a7d905d997e418. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:27:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a73ac2-3bea-4169-9236-1b4cd5ee7f27]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:08 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD Nov 01 12:27:08 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:09 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-761843902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d555df1c-b173-4653-b5d1-cdf8a8ad619e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41fe6e3adbe04124a53656647b049f96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:07Z,use_quota=True,user_id='96cc7dcb28544e39a7a7d905d997e418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Creating volume d555df1c-b173-4653-b5d1-cdf8a8ad619e {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:09 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:09 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e 1073741824 Nov 01 12:27:09 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:09 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e 1073741824" returned: 0 in 0.691s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:09 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e Nov 01 12:27:09 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:10 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e" returned: 0 in 0.404s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:27:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:10 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Attempting download of c5fdc172-8826-4b34-a68d-2114e120626b ((None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}])) to volume d555df1c-b173-4653-b5d1-cdf8a8ad619e. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:27:10 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44a85ab-99df-4395-b77d-147329ce0dd4]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_ml_t7722 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:10 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_ml_t7722 Nov 01 12:27:10 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:11 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_ml_t7722" returned: 0 in 0.575s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_ml_t7722 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:11 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_ml_t7722 Nov 01 12:27:11 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:11 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_ml_t7722" returned: 1 in 0.499s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_ml_t7722' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:27:11 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[34deeacd-0afd-400e-b2dc-0b18bf1670ea]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:11 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD Nov 01 12:27:11 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:12 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:12 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] c5fdc172-8826-4b34-a68d-2114e120626b was qcow2, converting to qcow2 {{(pid=86812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:27:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:12 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e Nov 01 12:27:12 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:14 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e" returned: 0 in 2.829s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:14 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_6uty03thdevstack@QuobyteHD, size 112.00 MB, duration 2.83 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:27:14 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Converted 112.00 MB image at 39.58 MB/s Nov 01 12:27:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:14 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e 1G Nov 01 12:27:14 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:15 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e 1G" returned: 0 in 0.724s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Downloaded image c5fdc172-8826-4b34-a68d-2114e120626b ((None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}])) to volume d555df1c-b173-4653-b5d1-cdf8a8ad619e successfully. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Temporary image c5fdc172-8826-4b34-a68d-2114e120626b for user 96cc7dcb28544e39a7a7d905d997e418 is deleted. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Marking volume d555df1c-b173-4653-b5d1-cdf8a8ad619e as bootable. {{(pid=86812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Copying metadata from image c5fdc172-8826-4b34-a68d-2114e120626b to d555df1c-b173-4653-b5d1-cdf8a8ad619e. {{(pid=86812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Creating volume glance metadata for volume d555df1c-b173-4653-b5d1-cdf8a8ad619e backed by image c5fdc172-8826-4b34-a68d-2114e120626b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Flow 'volume_create_manager' (4d76649d-fdac-48b6-bbc3-465ec955b21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ec44a7-cdcc-4cf4-9736-e4b86ec455df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ec44a7-cdcc-4cf4-9736-e4b86ec455df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1905082466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053973ea-8156-4836-bc64-70a2d276dd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8fd439e0906497c96afbfbc4970629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:16Z,use_quota=True,user_id='e4768c5fa4274badb1e357540afce1ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5d2e1f-6678-4d2f-8257-cf8a2e455166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5d2e1f-6678-4d2f-8257-cf8a2e455166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a28340-647e-4042-8b6e-03fcbea99332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a28340-647e-4042-8b6e-03fcbea99332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '053973ea-8156-4836-bc64-70a2d276dd8c', 'volume_name': 'volume-053973ea-8156-4836-bc64-70a2d276dd8c', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d8aab1-4ab4-4c7d-a71b-c459a0785a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d8aab1-4ab4-4c7d-a71b-c459a0785a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1227115e-95e4-4284-b281-ef4d77befd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:15 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Volume 053973ea-8156-4836-bc64-70a2d276dd8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-053973ea-8156-4836-bc64-70a2d276dd8c', 'volume_size': 1} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1905082466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053973ea-8156-4836-bc64-70a2d276dd8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8fd439e0906497c96afbfbc4970629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:16Z,use_quota=True,user_id='e4768c5fa4274badb1e357540afce1ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Creating volume 053973ea-8156-4836-bc64-70a2d276dd8c {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:15 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:15 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c 1073741824 Nov 01 12:27:15 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c37a61-39c5-4072-9b74-6aa28197399e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16da0991-8adc-421e-9140-27854ec32753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:16 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Volume volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e (d555df1c-b173-4653-b5d1-cdf8a8ad619e): created successfully Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16da0991-8adc-421e-9140-27854ec32753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Flow 'volume_create_manager' (0cb753bd-7477-4755-ac66-6e9129e63c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9c0625c9-e9d1-4420-bfd6-ef1582e7cd3b tempest-VolumesImageMetadata-1568075365 None] Created volume successfully. Nov 01 12:27:16 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c 1073741824" returned: 0 in 0.592s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:16 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c Nov 01 12:27:16 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:16 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c" returned: 0 in 0.347s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1227115e-95e4-4284-b281-ef4d77befd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053973ea-8156-4836-bc64-70a2d276dd8c', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bcbc4a8-5bdd-445d-b9d9-d16219539aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:16 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Volume volume-053973ea-8156-4836-bc64-70a2d276dd8c (053973ea-8156-4836-bc64-70a2d276dd8c): created successfully Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bcbc4a8-5bdd-445d-b9d9-d16219539aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Flow 'volume_create_manager' (4d76649d-fdac-48b6-bbc3-465ec955b21c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6cd9cb14-55e6-443c-8f12-41fc8f2eebdb tempest-SnapshotDependencyTests-1914321143 None] Created volume successfully. Nov 01 12:27:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Acquiring lock "cinder-d555df1c-b173-4653-b5d1-cdf8a8ad619e-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Lock "cinder-d555df1c-b173-4653-b5d1-cdf8a8ad619e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Acquiring lock "cinder-quobyte-d555df1c-b173-4653-b5d1-cdf8a8ad619e" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Lock "cinder-quobyte-d555df1c-b173-4653-b5d1-cdf8a8ad619e" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c55f5b-132a-4d46-8b39-acd308d5ebcb]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Creating offline snapshot 188a1386-3240-4754-ac3b-c5a25e99ed7a of volume 053973ea-8156-4836-bc64-70a2d276dd8c {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:27:18 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e Nov 01 12:27:18 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09a11b1-f5a8-4e58-a5d2-71a85a9042e9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:18 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c Nov 01 12:27:18 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:18 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e" returned: 0 in 0.487s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:18 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e Nov 01 12:27:18 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:18 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c" returned: 0 in 0.467s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:18 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a 1G Nov 01 12:27:18 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:18 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d555df1c-b173-4653-b5d1-cdf8a8ad619e" returned: 0 in 0.305s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Lock "cinder-quobyte-d555df1c-b173-4653-b5d1-cdf8a8ad619e" released by "delete_volume" :: held 0.867s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:18 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Created reservations ['dae53024-08d3-40cb-9e7a-9c9512840f42', 'c016364e-3807-4302-8bc1-4db80554db60', '24e46bbd-85e0-40a5-b8d4-938f6083ea5b', '69af7f5e-a1a7-49f1-8072-96f03a0797bc'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:19 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:27:19 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:19 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a 1G" returned: 0 in 0.648s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053973ea-8156-4836-bc64-70a2d276dd8c -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:19 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053973ea-8156-4836-bc64-70a2d276dd8c -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a Nov 01 12:27:19 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:19 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.412s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:19 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Deleted volume successfully. Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-737920da-f1f3-4e50-81ea-995bfd574cd1 tempest-VolumesImageMetadata-1568075365 None] Lock "cinder-d555df1c-b173-4653-b5d1-cdf8a8ad619e-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:19 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053973ea-8156-4836-bc64-70a2d276dd8c -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a" returned: 0 in 0.464s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:19 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a is being set with open permissions: ugo+rw Nov 01 12:27:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:19 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a Nov 01 12:27:19 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:20 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a" returned: 0 in 0.287s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:20 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.info Nov 01 12:27:20 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:20 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.info" returned: 0 in 0.287s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:20 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.info is being set with open permissions: ugo+rw Nov 01 12:27:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:20 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.info Nov 01 12:27:20 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:20 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.info" returned: 0 in 0.307s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.567s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:20 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-aa2372dc-ce19-4f1d-b4ad-42874ab18738 tempest-SnapshotDependencyTests-1914321143 None] Create snapshot completed successfully Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Flow 'volume_create_manager' (0d0dfc1c-2e7f-4459-819f-b7bab0a2a6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28b6dde-da7b-4c50-abe8-470be9181101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28b6dde-da7b-4c50-abe8-470be9181101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681eaab0-bc6a-46fd-a905-5d265b27cee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8fd439e0906497c96afbfbc4970629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=188a1386-3240-4754-ac3b-c5a25e99ed7a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:22Z,use_quota=True,user_id='e4768c5fa4274badb1e357540afce1ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae43bc5-18e2-44bd-b17f-0627d56475bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae43bc5-18e2-44bd-b17f-0627d56475bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80475bc3-7f90-4459-92df-bb11eb8367af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80475bc3-7f90-4459-92df-bb11eb8367af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '681eaab0-bc6a-46fd-a905-5d265b27cee3', 'volume_name': 'volume-681eaab0-bc6a-46fd-a905-5d265b27cee3', 'volume_size': 1, 'snapshot_id': '188a1386-3240-4754-ac3b-c5a25e99ed7a'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fbc787-eb59-4230-bdda-73692357cc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27fbc787-eb59-4230-bdda-73692357cc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc00d39-a01b-4e74-b853-cc731842ac07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:22 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Volume 681eaab0-bc6a-46fd-a905-5d265b27cee3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-681eaab0-bc6a-46fd-a905-5d265b27cee3', 'volume_size': 1, 'snapshot_id': '188a1386-3240-4754-ac3b-c5a25e99ed7a'} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "cinder-quobyte-188a1386-3240-4754-ac3b-c5a25e99ed7a-681eaab0-bc6a-46fd-a905-5d265b27cee3" by "_create_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-188a1386-3240-4754-ac3b-c5a25e99ed7a-681eaab0-bc6a-46fd-a905-5d265b27cee3" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Creating volume 681eaab0-bc6a-46fd-a905-5d265b27cee3 from snapshot 188a1386-3240-4754-ac3b-c5a25e99ed7a {{(pid=86812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "cinder-quobyte-681eaab0-bc6a-46fd-a905-5d265b27cee3" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-681eaab0-bc6a-46fd-a905-5d265b27cee3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] snapshot: 188a1386-3240-4754-ac3b-c5a25e99ed7a, volume: 681eaab0-bc6a-46fd-a905-5d265b27cee3, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[70241ac6-9aa5-4548-8195-6ab910a1c5a9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:22 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a Nov 01 12:27:22 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:22 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a" returned: 0 in 0.384s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-053973ea-8156-4836-bc64-70a2d276dd8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df389d1-4901-47b1-9d5b-29282e8fd511]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:22 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c Nov 01 12:27:22 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:23 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c" returned: 0 in 0.403s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:27:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:27:23 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:27:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:23 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 Nov 01 12:27:23 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Flow 'volume_create_manager' (f6ff2177-66d6-409a-9ec9-e2361ec29983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb5105f-2193-4f7e-b12d-8745e131b5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb5105f-2193-4f7e-b12d-8745e131b5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-50169673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c7c7bb-e641-48f6-a878-70704fa12fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdfdba00935446ea24de606b948f522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:25Z,use_quota=True,user_id='db4b179dc5004d75b253148509d5e654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f173a91-525d-4643-b85b-4d99923b4ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f173a91-525d-4643-b85b-4d99923b4ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73609fc4-f918-4d05-b294-5176de912734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73609fc4-f918-4d05-b294-5176de912734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c7c7bb-e641-48f6-a878-70704fa12fda', 'volume_name': 'volume-11c7c7bb-e641-48f6-a878-70704fa12fda', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac6bd56-4f13-4514-8fd4-4812858afabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac6bd56-4f13-4514-8fd4-4812858afabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83209b37-4876-4e2d-bc75-0032030484b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Volume 11c7c7bb-e641-48f6-a878-70704fa12fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c7c7bb-e641-48f6-a878-70704fa12fda', 'volume_size': 1} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Flow 'volume_create_manager' (d3b3cf5e-ed4d-4dc2-9689-74b7229a48a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbfde77-0887-475e-9d26-fb5c27bff733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbfde77-0887-475e-9d26-fb5c27bff733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1220090175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041114db-8b2c-415b-a63e-eb5c33b87da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3d3c0b964f41dda4a1f10a4cc399f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:26Z,use_quota=True,user_id='d781a160083a47f48da3c5358743cc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c6d323-e39b-4e5b-a53e-786b4c307aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68c6d323-e39b-4e5b-a53e-786b4c307aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b54f2e2-de64-42d1-b966-a56c78042f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b54f2e2-de64-42d1-b966-a56c78042f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '041114db-8b2c-415b-a63e-eb5c33b87da0', 'volume_name': 'volume-041114db-8b2c-415b-a63e-eb5c33b87da0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42a8ab3-7497-48bd-89d9-95a0cbd3a7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42a8ab3-7497-48bd-89d9-95a0cbd3a7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94ed766-bc4f-4023-898e-f29160f51853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:26 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Volume 041114db-8b2c-415b-a63e-eb5c33b87da0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-041114db-8b2c-415b-a63e-eb5c33b87da0', 'volume_size': 1} Nov 01 12:27:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:30 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3" returned: 0 in 7.295s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:27:30 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Converted 1024.00 MB image at 140.36 MB/s Nov 01 12:27:30 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 is being set with open permissions: ugo+rw Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:30 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 Nov 01 12:27:30 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:30 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3" returned: 0 in 0.381s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-681eaab0-bc6a-46fd-a905-5d265b27cee3" released by "_copy_volume_from_snapshot" :: held 8.568s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-188a1386-3240-4754-ac3b-c5a25e99ed7a-681eaab0-bc6a-46fd-a905-5d265b27cee3" released by "_create_volume_from_snapshot" :: held 8.641s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.656s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.415s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-50169673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c7c7bb-e641-48f6-a878-70704fa12fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdfdba00935446ea24de606b948f522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:25Z,use_quota=True,user_id='db4b179dc5004d75b253148509d5e654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Creating volume 11c7c7bb-e641-48f6-a878-70704fa12fda {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:30 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:30 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda 1073741824 Nov 01 12:27:30 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bc00d39-a01b-4e74-b853-cc731842ac07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681eaab0-bc6a-46fd-a905-5d265b27cee3', 'volume_size': 1, 'snapshot_id': '188a1386-3240-4754-ac3b-c5a25e99ed7a'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4e6406-402b-4875-8c70-e42cc3cc7c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:30 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Volume volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 (681eaab0-bc6a-46fd-a905-5d265b27cee3): created successfully Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4e6406-402b-4875-8c70-e42cc3cc7c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Flow 'volume_create_manager' (0d0dfc1c-2e7f-4459-819f-b7bab0a2a6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:30 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-2822831e-397f-4238-8dbf-80bc24bd94ff tempest-SnapshotDependencyTests-1914321143 None] Created volume successfully. Nov 01 12:27:31 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda 1073741824" returned: 0 in 0.459s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:31 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda Nov 01 12:27:31 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:31 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda" returned: 0 in 0.278s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.452s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1220090175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=041114db-8b2c-415b-a63e-eb5c33b87da0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db3d3c0b964f41dda4a1f10a4cc399f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:26Z,use_quota=True,user_id='d781a160083a47f48da3c5358743cc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Creating volume 041114db-8b2c-415b-a63e-eb5c33b87da0 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:31 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83209b37-4876-4e2d-bc75-0032030484b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c7c7bb-e641-48f6-a878-70704fa12fda', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:31 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0 1073741824 Nov 01 12:27:31 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ec1add-0803-430b-9619-aa40654d5f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:31 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Volume volume-11c7c7bb-e641-48f6-a878-70704fa12fda (11c7c7bb-e641-48f6-a878-70704fa12fda): created successfully Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ec1add-0803-430b-9619-aa40654d5f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Flow 'volume_create_manager' (f6ff2177-66d6-409a-9ec9-e2361ec29983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:31 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8b71fe4a-99bd-4e7f-8e35-6244c5863ecc tempest-VolumesTransfersTest-1335304803 None] Created volume successfully. Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "cinder-188a1386-3240-4754-ac3b-c5a25e99ed7a-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-188a1386-3240-4754-ac3b-c5a25e99ed7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "cinder-quobyte-053973ea-8156-4836-bc64-70a2d276dd8c" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-053973ea-8156-4836-bc64-70a2d276dd8c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "cinder-quobyte-188a1386-3240-4754-ac3b-c5a25e99ed7a" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-188a1386-3240-4754-ac3b-c5a25e99ed7a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Deleting offline snapshot 188a1386-3240-4754-ac3b-c5a25e99ed7a of volume 053973ea-8156-4836-bc64-70a2d276dd8c {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] snapshot_file for this snap is: volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e072e9b8-a314-4f4a-b5ff-3ca48c4a9719]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:32 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0 1073741824" returned: 0 in 0.581s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:32 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a Nov 01 12:27:32 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:32 devstack sudo[96151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0 Nov 01 12:27:32 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:32 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0" returned: 0 in 0.268s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:32 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a" returned: 0 in 0.432s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-053973ea-8156-4836-bc64-70a2d276dd8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ce52ee-949c-4da2-a70c-cbf9d139ecbc]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94ed766-bc4f-4023-898e-f29160f51853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-041114db-8b2c-415b-a63e-eb5c33b87da0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd60b1a-3a3b-45eb-9f63-e9c30a0eda1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:32 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Volume volume-041114db-8b2c-415b-a63e-eb5c33b87da0 (041114db-8b2c-415b-a63e-eb5c33b87da0): created successfully Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd60b1a-3a3b-45eb-9f63-e9c30a0eda1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Flow 'volume_create_manager' (d3b3cf5e-ed4d-4dc2-9689-74b7229a48a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:32 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5fc3488f-4cf1-4fbb-910c-63752fe032d1 tempest-AbsoluteLimitsTests-2104744642 None] Created volume successfully. Nov 01 12:27:32 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c Nov 01 12:27:32 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:33 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c" returned: 0 in 0.573s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:33 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a Nov 01 12:27:33 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:33 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a" returned: 0 in 0.471s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:33 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-363ed7a8-ca22-4f41-927c-caafdc798743 tempest-VolumesTransfersTest-2029074824 None] Transfer volume completed successfully. Nov 01 12:27:33 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a Nov 01 12:27:33 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Acquiring lock "cinder-041114db-8b2c-415b-a63e-eb5c33b87da0-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Lock "cinder-041114db-8b2c-415b-a63e-eb5c33b87da0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Acquiring lock "cinder-quobyte-041114db-8b2c-415b-a63e-eb5c33b87da0" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Lock "cinder-quobyte-041114db-8b2c-415b-a63e-eb5c33b87da0" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[217c6ebd-bda5-4efa-981b-cb36a2c59d8f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:34 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0 Nov 01 12:27:34 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:34 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c.188a1386-3240-4754-ac3b-c5a25e99ed7a" returned: 0 in 0.431s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-188a1386-3240-4754-ac3b-c5a25e99ed7a" released by "_delete_snapshot" :: held 2.081s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-053973ea-8156-4836-bc64-70a2d276dd8c" released by "delete_snapshot" :: held 2.115s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Created reservations ['598d2b7d-2398-4aee-befc-d925c06b2f65', '9210b302-8752-4c13-9589-de0944f837a9', '42109209-3a96-4207-887f-7d88675032b7', '4a0828ca-5ab9-4159-9001-0c26bbe216e5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:34 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Delete snapshot completed successfully. Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-95e765ca-4241-4578-90b6-bc9f53d24d08 tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-188a1386-3240-4754-ac3b-c5a25e99ed7a-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:34 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0" returned: 0 in 0.436s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:34 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0 Nov 01 12:27:34 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Acquiring lock "cinder-11c7c7bb-e641-48f6-a878-70704fa12fda-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Lock "cinder-11c7c7bb-e641-48f6-a878-70704fa12fda-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Acquiring lock "cinder-quobyte-11c7c7bb-e641-48f6-a878-70704fa12fda" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Lock "cinder-quobyte-11c7c7bb-e641-48f6-a878-70704fa12fda" acquired by "delete_volume" :: waited 0.034s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1752d302-4b86-42f5-9317-9791798986dd]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:34 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-041114db-8b2c-415b-a63e-eb5c33b87da0" returned: 0 in 0.286s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Lock "cinder-quobyte-041114db-8b2c-415b-a63e-eb5c33b87da0" released by "delete_volume" :: held 0.788s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:34 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda Nov 01 12:27:34 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Created reservations ['e06f3e69-2289-47ce-853e-980cdb0005c1', '78f28bc2-c612-45d7-9628-26dd32a974f3', 'b07dd03a-38cb-47d0-96f5-89bb604c0b73', '65ccb2a2-85bc-4beb-887c-cdf8ad295eb3'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:34 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:27:34 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:34 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda" returned: 0 in 0.461s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:35 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda Nov 01 12:27:35 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:35 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.285s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Deleted volume successfully. Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7842a105-6aca-482f-940d-7bc9ac2ba065 tempest-AbsoluteLimitsTests-2104744642 None] Lock "cinder-041114db-8b2c-415b-a63e-eb5c33b87da0-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "cinder-053973ea-8156-4836-bc64-70a2d276dd8c-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-053973ea-8156-4836-bc64-70a2d276dd8c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:35 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-11c7c7bb-e641-48f6-a878-70704fa12fda" returned: 0 in 0.360s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Lock "cinder-quobyte-11c7c7bb-e641-48f6-a878-70704fa12fda" released by "delete_volume" :: held 0.889s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "cinder-quobyte-053973ea-8156-4836-bc64-70a2d276dd8c" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-053973ea-8156-4836-bc64-70a2d276dd8c" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[934531e9-1c9b-431a-8451-54342bc25fcf]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Created reservations ['160a87ac-6188-44ef-8df5-3946967dc6b5', '2e05fcf0-c972-4990-b208-30a23f4657f4', '47fe220e-ca0d-478f-a3b1-f04b6dc8b478', '93504a10-c49d-423b-bcff-fb50f542b9a9'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:35 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c Nov 01 12:27:35 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:35 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:27:35 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:35 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c" returned: 0 in 0.479s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:35 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c Nov 01 12:27:35 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:35 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.380s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:35 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Deleted volume successfully. Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-718d6b27-a78b-435b-bd93-9fbbcf8a4be8 tempest-VolumesTransfersTest-1352443613 None] Lock "cinder-11c7c7bb-e641-48f6-a878-70704fa12fda-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:36 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-053973ea-8156-4836-bc64-70a2d276dd8c" returned: 0 in 0.290s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-053973ea-8156-4836-bc64-70a2d276dd8c" released by "delete_volume" :: held 0.850s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Created reservations ['6f005bc6-398d-4829-bbfe-9529e789aacf', '7ef6bb1b-b40b-42c8-9fe4-abf6fa8da1f6', '1fd1bade-4ca9-40ff-b321-5de9956d237b', '581f1652-f9f0-42a2-a3ad-c510271119d1'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:36 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:27:36 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "cinder-681eaab0-bc6a-46fd-a905-5d265b27cee3-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-681eaab0-bc6a-46fd-a905-5d265b27cee3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "cinder-quobyte-681eaab0-bc6a-46fd-a905-5d265b27cee3" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-681eaab0-bc6a-46fd-a905-5d265b27cee3" acquired by "delete_volume" :: waited 0.028s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae777d82-1704-49e3-b458-6a20ef6125ff]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:36 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.371s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:36 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Deleted volume successfully. Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-38c05d90-bbaa-4a7f-9480-b1d180f81c7f tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-053973ea-8156-4836-bc64-70a2d276dd8c-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:36 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 Nov 01 12:27:36 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:37 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:27:37 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:37 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3" returned: 0 in 0.690s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:37 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.426s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:37 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3 Nov 01 12:27:37 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Flow 'volume_create_manager' (b4196f88-414b-4be1-8d86-0287a9941d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693fd0a7-a0bc-4416-8130-22f74414b150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693fd0a7-a0bc-4416-8130-22f74414b150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-139067276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ac842a-696f-46d8-9d13-a5f3aca7f80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdfdba00935446ea24de606b948f522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:37Z,use_quota=True,user_id='db4b179dc5004d75b253148509d5e654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a12fab4-a198-487f-ad04-c8bfaec271ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a12fab4-a198-487f-ad04-c8bfaec271ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:37 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e61468f-89bc-4ad2-9bc8-fcf1fade8464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e61468f-89bc-4ad2-9bc8-fcf1fade8464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ac842a-696f-46d8-9d13-a5f3aca7f80c', 'volume_name': 'volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc48195-d253-40ea-b4ec-49dcc423305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc48195-d253-40ea-b4ec-49dcc423305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1123fe9-4f91-4956-ace2-3c512e2a31ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:37 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Volume b1ac842a-696f-46d8-9d13-a5f3aca7f80c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c', 'volume_size': 1} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-139067276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ac842a-696f-46d8-9d13-a5f3aca7f80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbdfdba00935446ea24de606b948f522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:37Z,use_quota=True,user_id='db4b179dc5004d75b253148509d5e654',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Creating volume b1ac842a-696f-46d8-9d13-a5f3aca7f80c {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:37 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-681eaab0-bc6a-46fd-a905-5d265b27cee3" returned: 0 in 0.383s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-quobyte-681eaab0-bc6a-46fd-a905-5d265b27cee3" released by "delete_volume" :: held 1.132s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:37 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c 1073741824 Nov 01 12:27:37 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Created reservations ['d3639b6d-adcd-42ec-ad3d-494c08e1d3c8', '60d3d981-1166-485a-bfe4-5781a7d84c4b', '40fbdbf0-007f-4542-82eb-7fa1520a8d5e', 'ed5edf44-152e-486f-b917-719d21374fdc'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:37 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:27:37 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:38 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.355s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:38 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Deleted volume successfully. Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b3fd4015-f17f-4087-8c13-35b24ba35947 tempest-SnapshotDependencyTests-1914321143 None] Lock "cinder-681eaab0-bc6a-46fd-a905-5d265b27cee3-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:38 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c 1073741824" returned: 0 in 0.693s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:38 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c Nov 01 12:27:38 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:38 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c" returned: 0 in 0.313s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1123fe9-4f91-4956-ace2-3c512e2a31ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f9d619-5be5-44b3-9b69-a4b9e600414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:38 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Volume volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c (b1ac842a-696f-46d8-9d13-a5f3aca7f80c): created successfully Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f9d619-5be5-44b3-9b69-a4b9e600414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Flow 'volume_create_manager' (b4196f88-414b-4be1-8d86-0287a9941d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:38 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-18966c55-1223-40b5-b458-ae6ec8737d05 tempest-VolumesTransfersTest-1335304803 None] Created volume successfully. Nov 01 12:27:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Acquiring lock "cinder-b1ac842a-696f-46d8-9d13-a5f3aca7f80c-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Lock "cinder-b1ac842a-696f-46d8-9d13-a5f3aca7f80c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:40 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=117,cinder:INSERT=37,cinder:UPDATE=147,cinder:DELETE=12 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:27:40 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=162,cinder:SELECT=107,cinder:DELETE=16,cinder:INSERT=47 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:27:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Acquiring lock "cinder-quobyte-b1ac842a-696f-46d8-9d13-a5f3aca7f80c" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Lock "cinder-quobyte-b1ac842a-696f-46d8-9d13-a5f3aca7f80c" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:40 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac10b1-d5a7-43c7-8b57-af3788396c67]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:40 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c Nov 01 12:27:40 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:41 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c" returned: 0 in 0.642s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:41 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c Nov 01 12:27:41 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:41 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1ac842a-696f-46d8-9d13-a5f3aca7f80c" returned: 0 in 0.424s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Lock "cinder-quobyte-b1ac842a-696f-46d8-9d13-a5f3aca7f80c" released by "delete_volume" :: held 1.159s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Created reservations ['1984326a-e961-46cf-84f3-9f0df0e31054', '6fec94ef-81a0-48c1-8e0e-f1fcbb94e39b', '232948f1-ee41-41c3-8277-356ae911d9a2', '0e5d4599-e491-42d3-ac04-ba69dfeb7308'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:41 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:27:41 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Flow 'volume_create_manager' (816dfbf3-3d1a-485c-8333-febdb8fafbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bc4ce7-8811-47c4-9b2c-f6cd05b05724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3bc4ce7-8811-47c4-9b2c-f6cd05b05724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-487453675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bbd6d0-87de-414f-bb33-ce141a572c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829ca8c7a5f84e4c84cd5479668463b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:42Z,use_quota=True,user_id='2953fb786a1b4f5792a9ed0c714985f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d81e9cc-0584-49e4-a859-c8eac2ac3fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d81e9cc-0584-49e4-a859-c8eac2ac3fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c0285b-fc4d-41cc-bf7e-18a246340b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c0285b-fc4d-41cc-bf7e-18a246340b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16bbd6d0-87de-414f-bb33-ce141a572c1f', 'volume_name': 'volume-16bbd6d0-87de-414f-bb33-ce141a572c1f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd7509b-6b09-48f8-8b37-a4f5cb185002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd7509b-6b09-48f8-8b37-a4f5cb185002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e487cd-eec8-47a0-b4f4-6ad1bc2a84ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:41 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Volume 16bbd6d0-87de-414f-bb33-ce141a572c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16bbd6d0-87de-414f-bb33-ce141a572c1f', 'volume_size': 1} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-487453675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bbd6d0-87de-414f-bb33-ce141a572c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829ca8c7a5f84e4c84cd5479668463b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:42Z,use_quota=True,user_id='2953fb786a1b4f5792a9ed0c714985f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Creating volume 16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:41 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:27:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:41 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f 1073741824 Nov 01 12:27:41 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:42 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.312s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Deleted volume successfully. Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccafef0f-65fe-4735-96c4-fe25f292033c tempest-VolumesTransfersTest-1352443613 None] Lock "cinder-b1ac842a-696f-46d8-9d13-a5f3aca7f80c-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:42 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f 1073741824" returned: 0 in 0.573s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:42 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f Nov 01 12:27:42 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:42 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f" returned: 0 in 0.376s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e487cd-eec8-47a0-b4f4-6ad1bc2a84ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16bbd6d0-87de-414f-bb33-ce141a572c1f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5806d2-3213-4ec3-988e-c5a78b5d72f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:42 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Volume volume-16bbd6d0-87de-414f-bb33-ce141a572c1f (16bbd6d0-87de-414f-bb33-ce141a572c1f): created successfully Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5806d2-3213-4ec3-988e-c5a78b5d72f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Flow 'volume_create_manager' (816dfbf3-3d1a-485c-8333-febdb8fafbf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bfed4b9e-150e-4313-8538-ab5cae3b5e74 tempest-VolumesDeleteCascade-1378904704 None] Created volume successfully. Nov 01 12:27:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Creating offline snapshot 613baa4b-6634-43c0-9ba8-a96515477cc2 of volume 16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:27:44 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b9e3b7-edd8-4651-ab48-77c5c4b7a580]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:45 devstack sudo[96344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f Nov 01 12:27:45 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:45 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f" returned: 0 in 0.976s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:45 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 1G Nov 01 12:27:45 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 1G" returned: 0 in 0.952s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bbd6d0-87de-414f-bb33-ce141a572c1f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:46 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:46 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bbd6d0-87de-414f-bb33-ce141a572c1f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 Nov 01 12:27:46 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:46 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bbd6d0-87de-414f-bb33-ce141a572c1f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2" returned: 0 in 0.363s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:46 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 is being set with open permissions: ugo+rw Nov 01 12:27:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:47 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 Nov 01 12:27:47 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:47 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2" returned: 0 in 0.420s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:47 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.info Nov 01 12:27:47 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:47 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.info" returned: 0 in 0.373s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:47 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.info is being set with open permissions: ugo+rw Nov 01 12:27:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:47 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.info Nov 01 12:27:47 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:48 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.info" returned: 0 in 0.266s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.527s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-47090400-c6cb-43af-bd7a-68c9e6997558 tempest-VolumesDeleteCascade-1378904704 None] Create snapshot completed successfully Nov 01 12:27:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] Creating offline snapshot 77fa3fef-b0cc-43f5-995d-03cac7d326c0 of volume 16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:27:49 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f7a8c1-6e45-485f-9df3-17b5db57a649]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:49 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 Nov 01 12:27:49 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:49 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2" returned: 0 in 0.449s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16bbd6d0-87de-414f-bb33-ce141a572c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:49 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 1G Nov 01 12:27:49 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:50 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 1G" returned: 0 in 0.584s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:50 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 Nov 01 12:27:50 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:50 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0" returned: 0 in 0.335s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:50 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 is being set with open permissions: ugo+rw Nov 01 12:27:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:50 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 Nov 01 12:27:50 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:50 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0" returned: 0 in 0.297s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4f66eb6c-78a4-4bae-a021-157da9a0c088 tempest-VolumesDeleteCascade-1378904704 None] Create snapshot completed successfully Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-16bbd6d0-87de-414f-bb33-ce141a572c1f-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-16bbd6d0-87de-414f-bb33-ce141a572c1f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Performing cascade delete. {{(pid=86812) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-613baa4b-6634-43c0-9ba8-a96515477cc2-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-613baa4b-6634-43c0-9ba8-a96515477cc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-16bbd6d0-87de-414f-bb33-ce141a572c1f" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-16bbd6d0-87de-414f-bb33-ce141a572c1f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-613baa4b-6634-43c0-9ba8-a96515477cc2" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-613baa4b-6634-43c0-9ba8-a96515477cc2" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Deleting offline snapshot 613baa4b-6634-43c0-9ba8-a96515477cc2 of volume 16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] snapshot_file for this snap is: volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e1573e-536b-4b34-81f3-aed937ed34e2]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:52 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 Nov 01 12:27:52 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:52 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2" returned: 0 in 0.524s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16bbd6d0-87de-414f-bb33-ce141a572c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:52 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b4aa9e-245f-46f9-b0ca-283daa18948c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:52 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f Nov 01 12:27:52 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:52 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f" returned: 0 in 0.593s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1f524d-025f-49f3-b68b-01a306f40175]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:53 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 Nov 01 12:27:53 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:53 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0" returned: 0 in 0.483s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16bbd6d0-87de-414f-bb33-ce141a572c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b33631-aef2-475a-bb42-e54d02f766b0]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:53 devstack sudo[96423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 Nov 01 12:27:53 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:54 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2" returned: 0 in 0.606s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16bbd6d0-87de-414f-bb33-ce141a572c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:54 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea2ed15-8f51-4097-8604-9f7b11ceb721]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:54 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f Nov 01 12:27:54 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:54 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f" returned: 0 in 0.432s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:54 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 Nov 01 12:27:54 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:55 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2" returned: 0 in 0.439s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:55 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2 Nov 01 12:27:55 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:55 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.613baa4b-6634-43c0-9ba8-a96515477cc2" returned: 0 in 0.287s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bbd6d0-87de-414f-bb33-ce141a572c1f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 -F qcow2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:55 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bbd6d0-87de-414f-bb33-ce141a572c1f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 -F qcow2 Nov 01 12:27:55 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:55 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16bbd6d0-87de-414f-bb33-ce141a572c1f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 -F qcow2" returned: 0 in 0.337s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-613baa4b-6634-43c0-9ba8-a96515477cc2" released by "_delete_snapshot" :: held 3.967s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-16bbd6d0-87de-414f-bb33-ce141a572c1f" released by "delete_snapshot" :: held 4.021s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Created reservations ['18689e1a-1280-4518-b779-98f9eab2240a', '4b61746a-7048-4203-ae0b-b74dfe043f28', 'b642b4da-f5b5-4e4d-a652-86ad7ab7eae5', 'a2ad1cd7-855e-467e-9ef2-277443b8c9f2'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:55 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Delete snapshot completed successfully. Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-613baa4b-6634-43c0-9ba8-a96515477cc2-delete_snapshot" released by "delete_snapshot" :: held 4.229s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-77fa3fef-b0cc-43f5-995d-03cac7d326c0-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-77fa3fef-b0cc-43f5-995d-03cac7d326c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-16bbd6d0-87de-414f-bb33-ce141a572c1f" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-16bbd6d0-87de-414f-bb33-ce141a572c1f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-77fa3fef-b0cc-43f5-995d-03cac7d326c0" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-77fa3fef-b0cc-43f5-995d-03cac7d326c0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Deleting offline snapshot 77fa3fef-b0cc-43f5-995d-03cac7d326c0 of volume 16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:27:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] snapshot_file for this snap is: volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:27:56 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3c91f1-239b-4f20-a18a-3662256cefa9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:56 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 Nov 01 12:27:56 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:56 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0" returned: 0 in 0.413s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16bbd6d0-87de-414f-bb33-ce141a572c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:56 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[07728387-a89b-4d52-baf3-58eed070abe3]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:56 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f Nov 01 12:27:56 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:56 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f" returned: 0 in 0.365s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:56 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 Nov 01 12:27:56 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:57 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0" returned: 0 in 0.347s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:57 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0 Nov 01 12:27:57 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:57 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f.77fa3fef-b0cc-43f5-995d-03cac7d326c0" returned: 0 in 0.303s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-77fa3fef-b0cc-43f5-995d-03cac7d326c0" released by "_delete_snapshot" :: held 1.581s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-16bbd6d0-87de-414f-bb33-ce141a572c1f" released by "delete_snapshot" :: held 1.618s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Created reservations ['60db021e-3432-4e62-8ba1-88110c05834b', '6995c952-86ba-42a1-9a2c-ae2d9d8abcfe', 'cfe697f5-2148-4bf7-a05c-2e5b8667671f', '8a7861f1-c527-415e-bed8-3a8079a35042'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:57 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Delete snapshot completed successfully. Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-77fa3fef-b0cc-43f5-995d-03cac7d326c0-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Snapshots deleted, issuing volume delete {{(pid=86812) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-16bbd6d0-87de-414f-bb33-ce141a572c1f" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-16bbd6d0-87de-414f-bb33-ce141a572c1f" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a53396-e3d4-4ccc-8d8c-3c801da31be3]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:58 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f Nov 01 12:27:58 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:58 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f" returned: 0 in 0.506s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:58 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f Nov 01 12:27:58 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:58 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-16bbd6d0-87de-414f-bb33-ce141a572c1f" returned: 0 in 0.248s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-16bbd6d0-87de-414f-bb33-ce141a572c1f" released by "delete_volume" :: held 0.839s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Created reservations ['1b36bfd5-ad00-41f3-80eb-945d47b811a5', '7218a4be-8c38-4fec-a9b3-d2ad5c83ba6c', '75631ce3-bb8a-442e-9dc4-64648c1e0927', 'ebab8de0-8c4b-4251-a932-f112b439f9e5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:58 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:27:58 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:59 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.246s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:59 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:59 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Deleted volume successfully. Nov 01 12:27:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07e46b1e-78ff-41da-bd18-adf60db3ef5d tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-16bbd6d0-87de-414f-bb33-ce141a572c1f-delete_volume" released by "delete_volume" :: held 7.514s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Flow 'volume_create_manager' (d5878f6c-d4bd-4359-af5f-0fb75fefb059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648dc851-f042-49f9-b894-f88696218526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648dc851-f042-49f9-b894-f88696218526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-942549513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef3c6df-8815-4b00-a98e-2cafd9f97328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829ca8c7a5f84e4c84cd5479668463b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:00Z,use_quota=True,user_id='2953fb786a1b4f5792a9ed0c714985f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b36511-8187-4ae0-9155-08bdfe6d9a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b36511-8187-4ae0-9155-08bdfe6d9a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22bf249-5dcc-4861-8152-c397a0f5e3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22bf249-5dcc-4861-8152-c397a0f5e3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef3c6df-8815-4b00-a98e-2cafd9f97328', 'volume_name': 'volume-fef3c6df-8815-4b00-a98e-2cafd9f97328', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee3894c-f07a-4e0a-b3bf-0f93221ead64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee3894c-f07a-4e0a-b3bf-0f93221ead64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b75839-6b95-40b6-b5e0-62708b7e907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:00 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Volume fef3c6df-8815-4b00-a98e-2cafd9f97328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef3c6df-8815-4b00-a98e-2cafd9f97328', 'volume_size': 1} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-942549513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef3c6df-8815-4b00-a98e-2cafd9f97328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829ca8c7a5f84e4c84cd5479668463b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:00Z,use_quota=True,user_id='2953fb786a1b4f5792a9ed0c714985f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Creating volume fef3c6df-8815-4b00-a98e-2cafd9f97328 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:00 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:00 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 1073741824 Nov 01 12:28:00 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:00 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 1073741824" returned: 0 in 0.477s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:00 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 Nov 01 12:28:00 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:01 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328" returned: 0 in 0.257s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b75839-6b95-40b6-b5e0-62708b7e907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef3c6df-8815-4b00-a98e-2cafd9f97328', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b3035d-31b7-48f1-9b1d-162de7faa1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:01 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Volume volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 (fef3c6df-8815-4b00-a98e-2cafd9f97328): created successfully Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b3035d-31b7-48f1-9b1d-162de7faa1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Flow 'volume_create_manager' (d5878f6c-d4bd-4359-af5f-0fb75fefb059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:01 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1b2fd9fb-f43f-459a-86e6-86127cb68c89 tempest-VolumesDeleteCascade-1378904704 None] Created volume successfully. Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Creating offline snapshot a040c7bf-d06b-483e-b66a-901997e99914 of volume fef3c6df-8815-4b00-a98e-2cafd9f97328 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2519c4-13f7-47c4-919c-940394aeaa35]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:01 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 Nov 01 12:28:01 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:01 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328" returned: 0 in 0.411s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:01 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 1G Nov 01 12:28:01 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:02 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 1G" returned: 0 in 0.449s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:02 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 Nov 01 12:28:02 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:02 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914" returned: 0 in 0.322s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:02 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 is being set with open permissions: ugo+rw Nov 01 12:28:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:02 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 Nov 01 12:28:02 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:02 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914" returned: 0 in 0.274s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:03 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.info Nov 01 12:28:03 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:03 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.info" returned: 0 in 0.273s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:03 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.info is being set with open permissions: ugo+rw Nov 01 12:28:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:03 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.info Nov 01 12:28:03 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:03 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.info" returned: 0 in 0.282s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:03 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d1fb76d0-c276-4326-8afe-ed0d9515a729 tempest-VolumesDeleteCascade-1378904704 None] Create snapshot completed successfully Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Flow 'volume_create_manager' (131fe4f3-b76d-4905-90e1-43315a609468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ba15d4-0a46-41c8-bb66-4133cbde8fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ba15d4-0a46-41c8-bb66-4133cbde8fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-178211822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b288a6-e5e1-407b-aba1-6a3c8dbaada0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='829ca8c7a5f84e4c84cd5479668463b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a040c7bf-d06b-483e-b66a-901997e99914,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:05Z,use_quota=True,user_id='2953fb786a1b4f5792a9ed0c714985f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e224ab6a-3ebe-40e4-b479-d2987c8bb142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e224ab6a-3ebe-40e4-b479-d2987c8bb142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d4ba05-5ed4-4104-99ce-2f176f4bedfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d4ba05-5ed4-4104-99ce-2f176f4bedfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '66b288a6-e5e1-407b-aba1-6a3c8dbaada0', 'volume_name': 'volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0', 'volume_size': 1, 'snapshot_id': 'a040c7bf-d06b-483e-b66a-901997e99914'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1062bc8-4b1a-47a4-84f3-585876b5a3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1062bc8-4b1a-47a4-84f3-585876b5a3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9a84f3-268f-4a07-a251-bb62b69446ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:05 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Volume 66b288a6-e5e1-407b-aba1-6a3c8dbaada0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0', 'volume_size': 1, 'snapshot_id': 'a040c7bf-d06b-483e-b66a-901997e99914'} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-a040c7bf-d06b-483e-b66a-901997e99914-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" by "_create_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-a040c7bf-d06b-483e-b66a-901997e99914-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Creating volume 66b288a6-e5e1-407b-aba1-6a3c8dbaada0 from snapshot a040c7bf-d06b-483e-b66a-901997e99914 {{(pid=86812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] snapshot: a040c7bf-d06b-483e-b66a-901997e99914, volume: 66b288a6-e5e1-407b-aba1-6a3c8dbaada0, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3173f148-efc6-4b3b-9625-a23246a5d2bf]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:05 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 Nov 01 12:28:05 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:06 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914" returned: 0 in 0.449s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fef3c6df-8815-4b00-a98e-2cafd9f97328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:28:06 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1226f672-fc8c-46f6-8c84-9d41813ae55c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:06 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 Nov 01 12:28:06 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:06 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328" returned: 0 in 0.451s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:28:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:28:06 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:28:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:06 devstack sudo[96584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 Nov 01 12:28:06 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Flow 'volume_create_manager' (edbb9eb6-6f39-4478-ad1d-53c9d567ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbdcdb8-0a5d-4cca-af8f-e75eb868ac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbdcdb8-0a5d-4cca-af8f-e75eb868ac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-162879017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08594f96-5743-4b60-bc02-0346285bc9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230f81ae54ab430bbd6ac190f2255b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:10Z,use_quota=True,user_id='256ab2c44fad474180ae33a7a084a3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623a09ea-bf8b-4d54-80e2-7fa2594a6569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623a09ea-bf8b-4d54-80e2-7fa2594a6569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93bc4a0-eca4-4c61-b3fd-103e15080051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93bc4a0-eca4-4c61-b3fd-103e15080051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08594f96-5743-4b60-bc02-0346285bc9dc', 'volume_name': 'volume-08594f96-5743-4b60-bc02-0346285bc9dc', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3a2a1b-66e9-49e8-89e2-276ed08a6daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b3a2a1b-66e9-49e8-89e2-276ed08a6daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11dc6aff-3da6-4c3d-8171-2af8fcf9212f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:10 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Volume 08594f96-5743-4b60-bc02-0346285bc9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08594f96-5743-4b60-bc02-0346285bc9dc', 'volume_size': 1} Nov 01 12:28:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:14 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" returned: 0 in 7.995s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328, size 1024.00 MB, duration 8.00 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:28:14 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Converted 1024.00 MB image at 128.07 MB/s Nov 01 12:28:14 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 is being set with open permissions: ugo+rw Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:14 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 Nov 01 12:28:14 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:14 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" returned: 0 in 0.305s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" released by "_copy_volume_from_snapshot" :: held 9.299s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-a040c7bf-d06b-483e-b66a-901997e99914-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" released by "_create_volume_from_snapshot" :: held 9.385s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.402s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.355s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-162879017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08594f96-5743-4b60-bc02-0346285bc9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230f81ae54ab430bbd6ac190f2255b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:10Z,use_quota=True,user_id='256ab2c44fad474180ae33a7a084a3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Creating volume 08594f96-5743-4b60-bc02-0346285bc9dc {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:14 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:14 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc 1073741824 Nov 01 12:28:14 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9a84f3-268f-4a07-a251-bb62b69446ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0', 'volume_size': 1, 'snapshot_id': 'a040c7bf-d06b-483e-b66a-901997e99914'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d166c800-bc0a-4ec5-a797-a819443e1708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:14 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Volume volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 (66b288a6-e5e1-407b-aba1-6a3c8dbaada0): created successfully Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d166c800-bc0a-4ec5-a797-a819443e1708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Flow 'volume_create_manager' (131fe4f3-b76d-4905-90e1-43315a609468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:14 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7c57fd1f-241f-42d4-a199-6dac7d7d647b tempest-VolumesDeleteCascade-1378904704 None] Created volume successfully. Nov 01 12:28:15 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc 1073741824" returned: 0 in 0.610s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-fef3c6df-8815-4b00-a98e-2cafd9f97328-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-fef3c6df-8815-4b00-a98e-2cafd9f97328-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:15 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc Nov 01 12:28:15 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Performing cascade delete. {{(pid=86812) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-a040c7bf-d06b-483e-b66a-901997e99914-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-a040c7bf-d06b-483e-b66a-901997e99914-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-fef3c6df-8815-4b00-a98e-2cafd9f97328" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-fef3c6df-8815-4b00-a98e-2cafd9f97328" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-a040c7bf-d06b-483e-b66a-901997e99914" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-a040c7bf-d06b-483e-b66a-901997e99914" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Deleting offline snapshot a040c7bf-d06b-483e-b66a-901997e99914 of volume fef3c6df-8815-4b00-a98e-2cafd9f97328 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] snapshot_file for this snap is: volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7250d5e8-1710-4806-83be-28e9b65525a6]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:15 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc" returned: 0 in 0.371s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11dc6aff-3da6-4c3d-8171-2af8fcf9212f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08594f96-5743-4b60-bc02-0346285bc9dc', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a57ecc-bd4c-4cc7-8a45-49c8fd195f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:15 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Volume volume-08594f96-5743-4b60-bc02-0346285bc9dc (08594f96-5743-4b60-bc02-0346285bc9dc): created successfully Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a57ecc-bd4c-4cc7-8a45-49c8fd195f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:15 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 Nov 01 12:28:15 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Flow 'volume_create_manager' (edbb9eb6-6f39-4478-ad1d-53c9d567ac55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:15 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-82f26f9f-7037-4070-aacd-61cd2af1778b tempest-AttachVolumeTestJSON-2032413549 None] Created volume successfully. Nov 01 12:28:16 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914" returned: 0 in 0.408s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fef3c6df-8815-4b00-a98e-2cafd9f97328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:28:16 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0b5d26-a0da-455d-b072-a6eb45b7d191]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:16 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 Nov 01 12:28:16 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:16 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328" returned: 0 in 0.699s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:17 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 Nov 01 12:28:17 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:17 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914" returned: 0 in 0.407s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:17 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914 Nov 01 12:28:17 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:17 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328.a040c7bf-d06b-483e-b66a-901997e99914" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-a040c7bf-d06b-483e-b66a-901997e99914" released by "_delete_snapshot" :: held 1.945s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-fef3c6df-8815-4b00-a98e-2cafd9f97328" released by "delete_snapshot" :: held 1.982s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Created reservations ['c11a7fc6-1556-415b-ae3f-b119a224c2ec', '4deb0e70-4eaf-4332-949c-dd16edf98424', '3b20436d-4b4c-4c79-8f81-b6f30b983725', '9d17e6d1-9a6a-4a5c-bd1e-cbafb7dd0706'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:17 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Delete snapshot completed successfully. Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-a040c7bf-d06b-483e-b66a-901997e99914-delete_snapshot" released by "delete_snapshot" :: held 2.247s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Snapshots deleted, issuing volume delete {{(pid=86812) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-fef3c6df-8815-4b00-a98e-2cafd9f97328" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-fef3c6df-8815-4b00-a98e-2cafd9f97328" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da7cfbb-a2b5-4fab-a4ee-339f4aae49fa]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-e19ca397-618e-4529-9065-4be9f7a852f5 req-e333c1ac-bc47-4419-a0cb-93e3551ba35d tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-e19ca397-618e-4529-9065-4be9f7a852f5 req-e333c1ac-bc47-4419-a0cb-93e3551ba35d tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-e19ca397-618e-4529-9065-4be9f7a852f5 req-e333c1ac-bc47-4419-a0cb-93e3551ba35d tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:18 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 Nov 01 12:28:18 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-e19ca397-618e-4529-9065-4be9f7a852f5 req-e333c1ac-bc47-4419-a0cb-93e3551ba35d tempest-AttachVolumeTestJSON-2032413549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-08594f96-5743-4b60-bc02-0346285bc9dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6a88011-a0b6-4f1d-90d2-68694706b6df', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:28:18 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-e19ca397-618e-4529-9065-4be9f7a852f5 req-e333c1ac-bc47-4419-a0cb-93e3551ba35d tempest-AttachVolumeTestJSON-2032413549 None] attachment_update completed successfully. Nov 01 12:28:18 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328" returned: 0 in 0.403s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:18 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328 Nov 01 12:28:18 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:18 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-fef3c6df-8815-4b00-a98e-2cafd9f97328" returned: 0 in 0.284s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-fef3c6df-8815-4b00-a98e-2cafd9f97328" released by "delete_volume" :: held 0.772s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Created reservations ['8e2dff1e-5c55-4789-ab29-26ee1f39afcd', 'fd7594dd-4588-4ad8-9984-f8d1d657bc75', 'd24ed668-a045-45a2-bbd0-cdaf3fb8238e', '06ef64c3-e3bb-4f9c-aafd-e338499e87d1'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:18 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:28:18 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-66b288a6-e5e1-407b-aba1-6a3c8dbaada0-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-66b288a6-e5e1-407b-aba1-6a3c8dbaada0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "cinder-quobyte-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:19 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" acquired by "delete_volume" :: waited 0.026s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.351s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:19 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Deleted volume successfully. Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab44cab-4e6a-4169-980c-dd61250a4c71]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-be15e4aa-6e29-4a4a-9aae-24a19a366385 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-fef3c6df-8815-4b00-a98e-2cafd9f97328-delete_volume" released by "delete_volume" :: held 3.717s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:19 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 Nov 01 12:28:19 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:19 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" returned: 0 in 0.372s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:19 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0 Nov 01 12:28:19 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:19 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-quobyte-66b288a6-e5e1-407b-aba1-6a3c8dbaada0" released by "delete_volume" :: held 0.679s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:19 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Created reservations ['7e86e44b-7b3a-463f-ab8a-bf25d4995758', 'a325b5b4-018c-46ac-9b4b-2583f906c99f', 'b1f6662b-80ad-4095-848f-640f405b00dc', '692924e3-0bd5-489e-89a6-2d66acaa3994'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:20 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:28:20 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:20 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.274s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:20 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Deleted volume successfully. Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-70489ea2-41e6-4e45-a18f-d4420d2d6fe0 tempest-VolumesDeleteCascade-1378904704 None] Lock "cinder-66b288a6-e5e1-407b-aba1-6a3c8dbaada0-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Flow 'volume_create_manager' (64f0b3c5-7991-4a61-8e5f-5b494e03e198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ec26d4-a0ef-4f4a-8499-b6cb15a541f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ec26d4-a0ef-4f4a-8499-b6cb15a541f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1338335032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dea6f62-19cc-4737-8f18-d69516d867e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230f81ae54ab430bbd6ac190f2255b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:21Z,use_quota=True,user_id='256ab2c44fad474180ae33a7a084a3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c18cb7-987e-413a-b538-a9678f2e1b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05c18cb7-987e-413a-b538-a9678f2e1b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac1527a-7cf4-463a-901d-59a109aade59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac1527a-7cf4-463a-901d-59a109aade59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dea6f62-19cc-4737-8f18-d69516d867e0', 'volume_name': 'volume-5dea6f62-19cc-4737-8f18-d69516d867e0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119f8fdb-f903-4686-ac64-5f7625c763dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119f8fdb-f903-4686-ac64-5f7625c763dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c272b392-24c7-4206-b2c3-f7412b818383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:20 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Volume 5dea6f62-19cc-4737-8f18-d69516d867e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dea6f62-19cc-4737-8f18-d69516d867e0', 'volume_size': 1} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1338335032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dea6f62-19cc-4737-8f18-d69516d867e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230f81ae54ab430bbd6ac190f2255b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:21Z,use_quota=True,user_id='256ab2c44fad474180ae33a7a084a3b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Creating volume 5dea6f62-19cc-4737-8f18-d69516d867e0 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:20 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:28:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:20 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0 1073741824 Nov 01 12:28:20 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Flow 'volume_create_manager' (4383a2bc-af92-49c3-bd53-7286223e89c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:21 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acffd0d1-c7a6-4f89-af7c-c797174b1d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0 1073741824" returned: 0 in 0.508s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acffd0d1-c7a6-4f89-af7c-c797174b1d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-964139710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0789ac-3881-4544-ae6c-32da7067fdde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b99db2793b4a6283792f7e9b60aa83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:21Z,use_quota=True,user_id='9917be26fefe4fc580018f0d8ed7138c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a828a7-f831-4575-b39a-feb869143da2),volume_type_id=56a828a7-f831-4575-b39a-feb869143da2)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6064c0b-a1eb-477b-83b9-047254904abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6064c0b-a1eb-477b-83b9-047254904abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201a67de-76d0-4826-8638-5b67a8e29b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201a67de-76d0-4826-8638-5b67a8e29b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0789ac-3881-4544-ae6c-32da7067fdde', 'volume_name': 'volume-9d0789ac-3881-4544-ae6c-32da7067fdde', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cfdfbe-7a28-4d7f-8b83-fdd6b5f689ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cfdfbe-7a28-4d7f-8b83-fdd6b5f689ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b789c6-2ab2-46e1-aba2-91058e783cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:21 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Volume 9d0789ac-3881-4544-ae6c-32da7067fdde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0789ac-3881-4544-ae6c-32da7067fdde', 'volume_size': 1} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:21 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0 Nov 01 12:28:21 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Flow 'volume_create_manager' (d7be0436-9409-4a9b-9001-bdbfd017c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef30918e-0688-4eb0-b966-00463ea7be81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef30918e-0688-4eb0-b966-00463ea7be81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1447484217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da11a140-b120-46fd-a6ce-cefdd93bb055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b99db2793b4a6283792f7e9b60aa83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:22Z,use_quota=True,user_id='9917be26fefe4fc580018f0d8ed7138c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(655a1410-1cdf-48d9-933e-1d4bd42f1cde),volume_type_id=655a1410-1cdf-48d9-933e-1d4bd42f1cde)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0525dc40-08a9-4950-9b26-bd3278c51e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0525dc40-08a9-4950-9b26-bd3278c51e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9ab22a-fce5-49b3-a346-c3bfca07a789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9ab22a-fce5-49b3-a346-c3bfca07a789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da11a140-b120-46fd-a6ce-cefdd93bb055', 'volume_name': 'volume-da11a140-b120-46fd-a6ce-cefdd93bb055', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c30ce2-c758-4b92-8e22-6f35dabecd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c30ce2-c758-4b92-8e22-6f35dabecd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf46c25-8fc0-4011-ac23-6acbbe63e4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:21 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Volume da11a140-b120-46fd-a6ce-cefdd93bb055: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da11a140-b120-46fd-a6ce-cefdd93bb055', 'volume_size': 1} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:21 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0" returned: 0 in 0.405s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-964139710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0789ac-3881-4544-ae6c-32da7067fdde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b99db2793b4a6283792f7e9b60aa83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:21Z,use_quota=True,user_id='9917be26fefe4fc580018f0d8ed7138c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(56a828a7-f831-4575-b39a-feb869143da2),volume_type_id=56a828a7-f831-4575-b39a-feb869143da2)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Creating volume 9d0789ac-3881-4544-ae6c-32da7067fdde {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:21 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:28:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c272b392-24c7-4206-b2c3-f7412b818383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dea6f62-19cc-4737-8f18-d69516d867e0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0587e0f7-3807-4b01-9bbf-79a4a7c496aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:22 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde 1073741824 Nov 01 12:28:22 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:22 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Volume volume-5dea6f62-19cc-4737-8f18-d69516d867e0 (5dea6f62-19cc-4737-8f18-d69516d867e0): created successfully Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0587e0f7-3807-4b01-9bbf-79a4a7c496aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Flow 'volume_create_manager' (64f0b3c5-7991-4a61-8e5f-5b494e03e198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bb7c8b76-4282-4faf-a6e0-eea9468ce949 tempest-AttachVolumeTestJSON-2032413549 None] Created volume successfully. Nov 01 12:28:22 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde 1073741824" returned: 0 in 0.557s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:22 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde Nov 01 12:28:22 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Flow 'volume_create_manager' (2ffeeb8b-cc60-46f7-adea-ecadc7b19110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbc1c16-a9fc-4fb5-8a3e-936c5fa5fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbc1c16-a9fc-4fb5-8a3e-936c5fa5fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1751151172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1026c9e2-4344-4be5-8683-7f71f7fad7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b99db2793b4a6283792f7e9b60aa83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:23Z,use_quota=True,user_id='9917be26fefe4fc580018f0d8ed7138c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78cba34c-7a6f-4d65-924e-29bc10198668),volume_type_id=78cba34c-7a6f-4d65-924e-29bc10198668)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2380e2f-e53d-4b34-87ce-13bd1db58fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2380e2f-e53d-4b34-87ce-13bd1db58fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050b576a-6b9d-4b95-930e-880abbdf81c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.image.glance [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Creating Keystone auth plugin from conf {{(pid=86812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:28:22 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde" returned: 0 in 0.278s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.912s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1447484217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da11a140-b120-46fd-a6ce-cefdd93bb055,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b99db2793b4a6283792f7e9b60aa83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:22Z,use_quota=True,user_id='9917be26fefe4fc580018f0d8ed7138c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(655a1410-1cdf-48d9-933e-1d4bd42f1cde),volume_type_id=655a1410-1cdf-48d9-933e-1d4bd42f1cde)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Creating volume da11a140-b120-46fd-a6ce-cefdd93bb055 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:22 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9b789c6-2ab2-46e1-aba2-91058e783cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0789ac-3881-4544-ae6c-32da7067fdde', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:22 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055 1073741824 Nov 01 12:28:22 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58150d34-298b-43fc-baad-54a6e4310700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:22 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Volume volume-9d0789ac-3881-4544-ae6c-32da7067fdde (9d0789ac-3881-4544-ae6c-32da7067fdde): created successfully Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58150d34-298b-43fc-baad-54a6e4310700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Flow 'volume_create_manager' (4383a2bc-af92-49c3-bd53-7286223e89c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f36a8689-8555-401e-9854-31d861a1026e tempest-TestInstancesWithCinderVolumes-1349637665 None] Created volume successfully. Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (050b576a-6b9d-4b95-930e-880abbdf81c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1026c9e2-4344-4be5-8683-7f71f7fad7b3', 'volume_name': 'volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3', 'volume_size': 1, 'image_id': '60d4bb44-3437-4808-bd53-3a5824517dd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60d4bb44-3437-4808-bd53-3a5824517dd9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2041380805', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '29b99db2793b4a6283792f7e9b60aa83', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60d4bb44-3437-4808-bd53-3a5824517dd9', 'created_at': datetime.datetime(2026, 11, 1, 11, 28, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 28, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60d4bb44-3437-4808-bd53-3a5824517dd9/file', 'properties': {}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c8b3bd-5c23-41cf-a759-acfdc62e71e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c8b3bd-5c23-41cf-a759-acfdc62e71e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2091e8c8-67df-4f07-a714-d970b54bb425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:23 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Volume 1026c9e2-4344-4be5-8683-7f71f7fad7b3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3', 'volume_size': 1, 'image_id': '60d4bb44-3437-4808-bd53-3a5824517dd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60d4bb44-3437-4808-bd53-3a5824517dd9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2041380805', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '29b99db2793b4a6283792f7e9b60aa83', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60d4bb44-3437-4808-bd53-3a5824517dd9', 'created_at': datetime.datetime(2026, 11, 1, 11, 28, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 28, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60d4bb44-3437-4808-bd53-3a5824517dd9/file', 'properties': {}}, 'image_service': } Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Trying to clone 1026c9e2-4344-4be5-8683-7f71f7fad7b3 from image 60d4bb44-3437-4808-bd53-3a5824517dd9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/60d4bb44-3437-4808-bd53-3a5824517dd9', 'metadata': {}}]). {{(pid=86812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:28:23 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055 1073741824" returned: 0 in 0.577s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:23 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055 Nov 01 12:28:23 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:23 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055" returned: 0 in 0.376s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf46c25-8fc0-4011-ac23-6acbbe63e4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da11a140-b120-46fd-a6ce-cefdd93bb055', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf65c78-8591-471f-9f50-76dc15ac1534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:23 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Volume volume-da11a140-b120-46fd-a6ce-cefdd93bb055 (da11a140-b120-46fd-a6ce-cefdd93bb055): created successfully Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf65c78-8591-471f-9f50-76dc15ac1534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Flow 'volume_create_manager' (d7be0436-9409-4a9b-9001-bdbfd017c403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3c6e93a7-b152-4e9a-b535-97cca974b855 tempest-TestInstancesWithCinderVolumes-1349637665 None] Created volume successfully. Nov 01 12:28:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-318089a7-df15-4cdc-ad63-ba4729493cea req-e2143a97-7969-4547-baa5-697e4e2710be tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-318089a7-df15-4cdc-ad63-ba4729493cea req-e2143a97-7969-4547-baa5-697e4e2710be tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-318089a7-df15-4cdc-ad63-ba4729493cea req-e2143a97-7969-4547-baa5-697e4e2710be tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-318089a7-df15-4cdc-ad63-ba4729493cea req-e2143a97-7969-4547-baa5-697e4e2710be tempest-AttachVolumeTestJSON-2032413549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-5dea6f62-19cc-4737-8f18-d69516d867e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32a05e43-2e6c-4e35-b3ef-1d258c10ba30', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:28:24 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-318089a7-df15-4cdc-ad63-ba4729493cea req-e2143a97-7969-4547-baa5-697e4e2710be tempest-AttachVolumeTestJSON-2032413549 None] attachment_update completed successfully. Nov 01 12:28:26 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-d5406480-6783-4691-9103-d361c5acbb56 req-20bf58eb-3aac-4900-842b-23e52b89b0a9 tempest-AttachVolumeTestJSON-2032413549 None] Terminate volume connection completed successfully. Nov 01 12:28:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-d5406480-6783-4691-9103-d361c5acbb56 req-20bf58eb-3aac-4900-842b-23e52b89b0a9 tempest-AttachVolumeTestJSON-2032413549 None] Deleting attachment e6a88011-a0b6-4f1d-90d2-68694706b6df. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:28:27 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD, size 20.69 MB, duration 3.92 sec {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:28:27 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Image download 20.69 MB at 5.28 MB/s Nov 01 12:28:27 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9caf2a2-bd90-4ef1-9129-5af96be1f39c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:27 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD Nov 01 12:28:27 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:27 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD" returned: 0 in 0.441s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:27 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Temporary image 60d4bb44-3437-4808-bd53-3a5824517dd9 is fetched for user 9917be26fefe4fc580018f0d8ed7138c. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:28:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-7d6f49d6-7831-4b53-80aa-07aafd182c11 req-c4cc1702-8fc6-48f5-a945-bb6270475f5b tempest-AttachVolumeTestJSON-2032413549 None] Terminate volume connection completed successfully. Nov 01 12:28:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-7d6f49d6-7831-4b53-80aa-07aafd182c11 req-c4cc1702-8fc6-48f5-a945-bb6270475f5b tempest-AttachVolumeTestJSON-2032413549 None] Deleting attachment 32a05e43-2e6c-4e35-b3ef-1d258c10ba30. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:28:27 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8042946-df5f-4f44-8f80-f5423206efbe]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:27 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD Nov 01 12:28:27 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:28 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1751151172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1026c9e2-4344-4be5-8683-7f71f7fad7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29b99db2793b4a6283792f7e9b60aa83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:23Z,use_quota=True,user_id='9917be26fefe4fc580018f0d8ed7138c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78cba34c-7a6f-4d65-924e-29bc10198668),volume_type_id=78cba34c-7a6f-4d65-924e-29bc10198668)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Creating volume 1026c9e2-4344-4be5-8683-7f71f7fad7b3 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:28 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:28 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 1073741824 Nov 01 12:28:28 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:28 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 1073741824" returned: 0 in 0.540s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:28 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 Nov 01 12:28:28 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:29 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3" returned: 0 in 0.366s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:29 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Attempting download of 60d4bb44-3437-4808-bd53-3a5824517dd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/60d4bb44-3437-4808-bd53-3a5824517dd9', 'metadata': {}}])) to volume 1026c9e2-4344-4be5-8683-7f71f7fad7b3. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:28:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[328cf404-e07f-4171-98f2-258d370600b3]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60d4bb44-3437-4808-bd53-3a5824517dd9__87pzsfl {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:29 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60d4bb44-3437-4808-bd53-3a5824517dd9__87pzsfl Nov 01 12:28:29 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:29 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60d4bb44-3437-4808-bd53-3a5824517dd9__87pzsfl" returned: 0 in 0.643s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60d4bb44-3437-4808-bd53-3a5824517dd9__87pzsfl {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:30 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60d4bb44-3437-4808-bd53-3a5824517dd9__87pzsfl Nov 01 12:28:30 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:30 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60d4bb44-3437-4808-bd53-3a5824517dd9__87pzsfl" returned: 1 in 0.392s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60d4bb44-3437-4808-bd53-3a5824517dd9__87pzsfl' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:28:30 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dbc68d-f53b-4fe0-aa52-f83a8d346700]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:30 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD Nov 01 12:28:30 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:30 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:30 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] 60d4bb44-3437-4808-bd53-3a5824517dd9 was qcow2, converting to qcow2 {{(pid=86812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:28:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:30 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 Nov 01 12:28:30 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:33 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3" returned: 0 in 2.406s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_60d4bb44-3437-4808-bd53-3a5824517dd9_3xo8x9a0devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:28:33 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Converted 112.00 MB image at 46.52 MB/s Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:33 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 1G Nov 01 12:28:33 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:33 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 1G" returned: 0 in 0.361s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Downloaded image 60d4bb44-3437-4808-bd53-3a5824517dd9 ((None, [{'url': 'file:///opt/stack/data/glance/images/60d4bb44-3437-4808-bd53-3a5824517dd9', 'metadata': {}}])) to volume 1026c9e2-4344-4be5-8683-7f71f7fad7b3 successfully. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Temporary image 60d4bb44-3437-4808-bd53-3a5824517dd9 for user 9917be26fefe4fc580018f0d8ed7138c is deleted. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Marking volume 1026c9e2-4344-4be5-8683-7f71f7fad7b3 as bootable. {{(pid=86812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "cinder-5dea6f62-19cc-4737-8f18-d69516d867e0-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Copying metadata from image 60d4bb44-3437-4808-bd53-3a5824517dd9 to 1026c9e2-4344-4be5-8683-7f71f7fad7b3. {{(pid=86812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Creating volume glance metadata for volume 1026c9e2-4344-4be5-8683-7f71f7fad7b3 backed by image 60d4bb44-3437-4808-bd53-3a5824517dd9 with: {'image_id': '60d4bb44-3437-4808-bd53-3a5824517dd9', 'image_name': 'tempest-scenario-img--2041380805', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-5dea6f62-19cc-4737-8f18-d69516d867e0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "cinder-quobyte-5dea6f62-19cc-4737-8f18-d69516d867e0" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-quobyte-5dea6f62-19cc-4737-8f18-d69516d867e0" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2091e8c8-67df-4f07-a714-d970b54bb425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3', 'volume_size': 1, 'image_id': '60d4bb44-3437-4808-bd53-3a5824517dd9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60d4bb44-3437-4808-bd53-3a5824517dd9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2041380805', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '29b99db2793b4a6283792f7e9b60aa83', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60d4bb44-3437-4808-bd53-3a5824517dd9', 'created_at': datetime.datetime(2026, 11, 1, 11, 28, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 28, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60d4bb44-3437-4808-bd53-3a5824517dd9/file', 'properties': {}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dad9732-f469-4fb1-b0c0-de3c1a087322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[907427f9-ec59-41ff-9af9-921de4dcd1d1]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:33 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Volume volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 (1026c9e2-4344-4be5-8683-7f71f7fad7b3): created successfully Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dad9732-f469-4fb1-b0c0-de3c1a087322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Flow 'volume_create_manager' (2ffeeb8b-cc60-46f7-adea-ecadc7b19110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:33 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ed7e4863-b4bc-4c50-9692-96c613e1a50b tempest-TestInstancesWithCinderVolumes-1349637665 None] Created volume successfully. Nov 01 12:28:33 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0 Nov 01 12:28:33 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:34 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0" returned: 0 in 0.416s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:34 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0 Nov 01 12:28:34 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:34 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5dea6f62-19cc-4737-8f18-d69516d867e0" returned: 0 in 0.241s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-quobyte-5dea6f62-19cc-4737-8f18-d69516d867e0" released by "delete_volume" :: held 0.717s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Created reservations ['ca043169-4066-4ef3-9a64-b6e68fb0779c', 'd65951b3-4a91-485d-a179-eea1095557e3', '3e8088aa-2ebb-4efb-84c8-1955d38e0278', '9786c22f-3b2c-4062-87c5-8410a7614f7f'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:34 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:28:34 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "cinder-08594f96-5743-4b60-bc02-0346285bc9dc-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-08594f96-5743-4b60-bc02-0346285bc9dc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "cinder-quobyte-08594f96-5743-4b60-bc02-0346285bc9dc" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-quobyte-08594f96-5743-4b60-bc02-0346285bc9dc" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:34 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.449s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:34 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Deleted volume successfully. Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd40169-9eb2-4caa-9383-dde9553f791e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-efd59e4c-e69a-4c94-8ec1-f1a76944b16e tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-5dea6f62-19cc-4737-8f18-d69516d867e0-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:35 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc Nov 01 12:28:35 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:35 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc" returned: 0 in 0.423s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:35 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc Nov 01 12:28:35 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:35 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08594f96-5743-4b60-bc02-0346285bc9dc" returned: 0 in 0.349s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-quobyte-08594f96-5743-4b60-bc02-0346285bc9dc" released by "delete_volume" :: held 0.849s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Created reservations ['350ba2bc-9b11-4c98-8155-b2a6c0aeee08', '91a0160f-1b1c-430e-9bd9-156c29690992', '45209cd7-4a4b-4701-b3a6-f432e4149a30', 'fda0f21c-a7cc-403b-a2ea-f48562b86517'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:35 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:28:35 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "cinder-66aaf56f-fc77-4e19-9509-4d00851ee827-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-66aaf56f-fc77-4e19-9509-4d00851ee827-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "cinder-quobyte-66aaf56f-fc77-4e19-9509-4d00851ee827" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-quobyte-66aaf56f-fc77-4e19-9509-4d00851ee827" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:36 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.400s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e9e2fd-cbe5-461a-a33a-ed3980caa218]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:36 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Deleted volume successfully. Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08d825a2-44f4-4bd8-ab25-9338e58b4050 tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-08594f96-5743-4b60-bc02-0346285bc9dc-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:36 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827 Nov 01 12:28:36 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:36 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827" returned: 0 in 0.504s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:36 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827 Nov 01 12:28:36 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:37 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:28:37 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:37 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-66aaf56f-fc77-4e19-9509-4d00851ee827" returned: 0 in 0.286s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-quobyte-66aaf56f-fc77-4e19-9509-4d00851ee827" released by "delete_volume" :: held 0.864s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Created reservations ['97cfb5e7-f545-4cab-89f0-633c8fdd41fc', '6082d325-3a9a-435f-abe2-ea2957442453', '1f272dee-8c5e-4194-852f-a7b884e93c6a', '1175e1f9-220d-495d-b7bc-b823b1c4340d'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:37 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:37 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:28:37 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Flow 'volume_create_manager' (2c8aef05-1d00-42a1-9913-a7a0eaf792f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12c9db2-1d9d-4bae-ab5b-b293c32af94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.413s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12c9db2-1d9d-4bae-ab5b-b293c32af94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-674844543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bfca15-307f-4c84-b61b-5bbcc667b026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03154b3416a4028be5a62dd984e42f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:37Z,use_quota=True,user_id='d37f645f0faa42c9969242038554da96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a70d770-1889-4a5e-b8f1-af9bcd88644c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a70d770-1889-4a5e-b8f1-af9bcd88644c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efddf151-ac6f-4b06-bb61-0aeaf01e5ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efddf151-ac6f-4b06-bb61-0aeaf01e5ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1bfca15-307f-4c84-b61b-5bbcc667b026', 'volume_name': 'volume-b1bfca15-307f-4c84-b61b-5bbcc667b026', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c970429b-2f54-414f-b8f6-ce3a0e616d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c970429b-2f54-414f-b8f6-ce3a0e616d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e868b4-1194-47fb-a67e-ff7151f6b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:37 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Volume b1bfca15-307f-4c84-b61b-5bbcc667b026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1bfca15-307f-4c84-b61b-5bbcc667b026', 'volume_size': 1} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-674844543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1bfca15-307f-4c84-b61b-5bbcc667b026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03154b3416a4028be5a62dd984e42f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:37Z,use_quota=True,user_id='d37f645f0faa42c9969242038554da96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Creating volume b1bfca15-307f-4c84-b61b-5bbcc667b026 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:37 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:37 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 1073741824 Nov 01 12:28:37 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:37 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.263s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:37 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Deleted volume successfully. Nov 01 12:28:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-01cf5255-c6b6-48e9-9e94-472c9b913929 tempest-AttachVolumeTestJSON-2032413549 None] Lock "cinder-66aaf56f-fc77-4e19-9509-4d00851ee827-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:38 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 1073741824" returned: 0 in 0.552s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:38 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 Nov 01 12:28:38 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-054d7e70-3381-40dd-8fca-d9d430d81b18 req-d2806a4a-fc5e-40f6-aa30-e5409a536183 tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:38 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026" returned: 0 in 0.263s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-054d7e70-3381-40dd-8fca-d9d430d81b18 req-d2806a4a-fc5e-40f6-aa30-e5409a536183 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.087s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e868b4-1194-47fb-a67e-ff7151f6b207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1bfca15-307f-4c84-b61b-5bbcc667b026', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6cc2e1-7fec-4b03-bcc8-5fb667be3f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-054d7e70-3381-40dd-8fca-d9d430d81b18 req-d2806a4a-fc5e-40f6-aa30-e5409a536183 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:38 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Volume volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 (b1bfca15-307f-4c84-b61b-5bbcc667b026): created successfully Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab6cc2e1-7fec-4b03-bcc8-5fb667be3f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Flow 'volume_create_manager' (2c8aef05-1d00-42a1-9913-a7a0eaf792f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:38 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6be3d070-659e-402e-bbcc-a1bac5f73ca4 tempest-VolumesActionsTest-735104446 None] Created volume successfully. Nov 01 12:28:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-054d7e70-3381-40dd-8fca-d9d430d81b18 req-d2806a4a-fc5e-40f6-aa30-e5409a536183 tempest-TestInstancesWithCinderVolumes-1349637665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76802870-59a6-472b-8ed2-2ef050c6606d', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:28:38 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-054d7e70-3381-40dd-8fca-d9d430d81b18 req-d2806a4a-fc5e-40f6-aa30-e5409a536183 tempest-TestInstancesWithCinderVolumes-1349637665 None] attachment_update completed successfully. Nov 01 12:28:45 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=107,cinder:INSERT=33,cinder:UPDATE=106,cinder:DELETE=12 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:28:45 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=107,cinder:INSERT=27,cinder:UPDATE=113,cinder:DELETE=7 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:28:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-62db7acb-a300-46e9-8a67-5979be618729 tempest-VolumesActionsTest-735104446 None] Acquiring lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026" by "attach_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-62db7acb-a300-46e9-8a67-5979be618729 tempest-VolumesActionsTest-735104446 None] Lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026" acquired by "attach_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:54 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-62db7acb-a300-46e9-8a67-5979be618729 tempest-VolumesActionsTest-735104446 None] Attaching volume b1bfca15-307f-4c84-b61b-5bbcc667b026 to instance ce3d03c8-46a4-4302-a131-233dc4d2e916 at mountpoint /dev/vdb on host None. Nov 01 12:28:54 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-62db7acb-a300-46e9-8a67-5979be618729 tempest-VolumesActionsTest-735104446 None] Attach volume completed successfully. Nov 01 12:28:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-62db7acb-a300-46e9-8a67-5979be618729 tempest-VolumesActionsTest-735104446 None] Lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026" released by "attach_volume" :: held 0.106s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0baefd85-ffac-477b-9dec-2ec53802e1b4 tempest-VolumesActionsTest-735104446 None] Acquiring lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026-detach_volume" by "detach_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0baefd85-ffac-477b-9dec-2ec53802e1b4 tempest-VolumesActionsTest-735104446 None] Lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:54 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0baefd85-ffac-477b-9dec-2ec53802e1b4 tempest-VolumesActionsTest-735104446 None] Detaching volume b1bfca15-307f-4c84-b61b-5bbcc667b026 from instance ce3d03c8-46a4-4302-a131-233dc4d2e916. Nov 01 12:28:54 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0baefd85-ffac-477b-9dec-2ec53802e1b4 tempest-VolumesActionsTest-735104446 None] Detach volume completed successfully. Nov 01 12:28:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0baefd85-ffac-477b-9dec-2ec53802e1b4 tempest-VolumesActionsTest-735104446 None] Lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:04 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=5 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:29:04 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:29:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-91532632-6827-45ae-ac2c-b19076be9a56 tempest-VolumesActionsTest-735104446 None] Acquiring lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026" by "attach_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-91532632-6827-45ae-ac2c-b19076be9a56 tempest-VolumesActionsTest-735104446 None] Lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026" acquired by "attach_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-91532632-6827-45ae-ac2c-b19076be9a56 tempest-VolumesActionsTest-735104446 None] Attaching volume b1bfca15-307f-4c84-b61b-5bbcc667b026 to instance f33b9cc8-8d6b-4427-a68a-5f5b9ad098f5 at mountpoint /dev/vdb on host None. Nov 01 12:29:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-91532632-6827-45ae-ac2c-b19076be9a56 tempest-VolumesActionsTest-735104446 None] Attach volume completed successfully. Nov 01 12:29:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-91532632-6827-45ae-ac2c-b19076be9a56 tempest-VolumesActionsTest-735104446 None] Lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026" released by "attach_volume" :: held 0.179s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52e13a3b-31db-4a25-a86c-6b6a5b89b2fe tempest-VolumesActionsTest-735104446 None] Acquiring lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026-detach_volume" by "detach_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52e13a3b-31db-4a25-a86c-6b6a5b89b2fe tempest-VolumesActionsTest-735104446 None] Lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:10 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-52e13a3b-31db-4a25-a86c-6b6a5b89b2fe tempest-VolumesActionsTest-735104446 None] Detaching volume b1bfca15-307f-4c84-b61b-5bbcc667b026 from instance f33b9cc8-8d6b-4427-a68a-5f5b9ad098f5. Nov 01 12:29:10 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-52e13a3b-31db-4a25-a86c-6b6a5b89b2fe tempest-VolumesActionsTest-735104446 None] Detach volume completed successfully. Nov 01 12:29:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-52e13a3b-31db-4a25-a86c-6b6a5b89b2fe tempest-VolumesActionsTest-735104446 None] Lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026-detach_volume" released by "detach_volume" :: held 0.183s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:15 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9f44c3-c955-4ecf-a526-3d9b9ff389a2]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:15 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 Nov 01 12:29:15 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:16 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026" returned: 0 in 0.371s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:16 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[353c5cff-99b0-498a-bc44-708ebc0e7358]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:16 devstack sudo[98206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 Nov 01 12:29:16 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:16 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026" returned: 0 in 0.385s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.5f084f6b-ccb3-4d46-bce6-eb654d10c332fjavdo3x.img {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:16 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.5f084f6b-ccb3-4d46-bce6-eb654d10c332fjavdo3x.img Nov 01 12:29:16 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-7dcef6a0-cd3c-453f-bc24-8a19a5219d42 req-189f8fd5-b7b7-4824-a1a0-0570daa1a544 tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:20 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:29:25 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.5f084f6b-ccb3-4d46-bce6-eb654d10c332fjavdo3x.img" returned: 0 in 8.518s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:25 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a697a245-d913-4eaf-a605-6b79e09817e1]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:25 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 Nov 01 12:29:25 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:25 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026" returned: 0 in 0.504s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:25 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026, size 1024.00 MB, duration 8.52 sec, destination /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.5f084f6b-ccb3-4d46-bce6-eb654d10c332fjavdo3x.img {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:29:25 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Converted 1024.00 MB image at 120.20 MB/s Nov 01 12:29:25 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] 5f084f6b-ccb3-4d46-bce6-eb654d10c332 was raw, no need to convert to raw {{(pid=86812) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 01 12:29:35 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:INSERT=2,cinder:SELECT=11,cinder:UPDATE=2 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:29:35 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:29:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:29:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:36 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:29:37 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:37 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.314s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:29:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:29:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Flow 'volume_create_manager' (ad41f76a-4918-436d-aea5-dc96c827edc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07a56c2-697c-4139-88ec-477515ce3aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07a56c2-697c-4139-88ec-477515ce3aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1406130220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8026340c-737a-43b4-9fd5-0ada3da3a4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8162183521a94f729dc51c6e25df9a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:39Z,use_quota=True,user_id='16dc6f4c54df478281a32e7da026e92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06712d32-e08c-4b61-8b48-c0df3a5c43bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06712d32-e08c-4b61-8b48-c0df3a5c43bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9666a16-6776-4da8-a12b-c91559591e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9666a16-6776-4da8-a12b-c91559591e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8026340c-737a-43b4-9fd5-0ada3da3a4ee', 'volume_name': 'volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ced6d47-655d-43a6-8764-dbec0bd69c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ced6d47-655d-43a6-8764-dbec0bd69c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c378ad-69fb-4da2-83e3-0aff96121444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:39 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Volume 8026340c-737a-43b4-9fd5-0ada3da3a4ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee', 'volume_size': 1} Nov 01 12:29:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.464s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Uploaded volume to glance image-id: 5f084f6b-ccb3-4d46-bce6-eb654d10c332. {{(pid=86812) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-7dcef6a0-cd3c-453f-bc24-8a19a5219d42 req-189f8fd5-b7b7-4824-a1a0-0570daa1a544 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 24.846s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-7dcef6a0-cd3c-453f-bc24-8a19a5219d42 req-189f8fd5-b7b7-4824-a1a0-0570daa1a544 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.790s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1406130220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8026340c-737a-43b4-9fd5-0ada3da3a4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8162183521a94f729dc51c6e25df9a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:39Z,use_quota=True,user_id='16dc6f4c54df478281a32e7da026e92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Creating volume 8026340c-737a-43b4-9fd5-0ada3da3a4ee {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:29:45 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:45 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f59521cb-038e-4b1c-8ffc-f358e860e223 tempest-VolumesActionsTest-735104446 None] Copy volume to image completed successfully. Nov 01 12:29:45 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee 1073741824 Nov 01 12:29:45 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-7dcef6a0-cd3c-453f-bc24-8a19a5219d42 req-189f8fd5-b7b7-4824-a1a0-0570daa1a544 tempest-TestInstancesWithCinderVolumes-1349637665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-9d0789ac-3881-4544-ae6c-32da7067fdde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96eec85e-3e4c-4d13-8945-a1354814e544', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:29:45 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-7dcef6a0-cd3c-453f-bc24-8a19a5219d42 req-189f8fd5-b7b7-4824-a1a0-0570daa1a544 tempest-TestInstancesWithCinderVolumes-1349637665 None] attachment_update completed successfully. Nov 01 12:29:45 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee 1073741824" returned: 0 in 0.533s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:45 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee Nov 01 12:29:45 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:46 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c378ad-69fb-4da2-83e3-0aff96121444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133be053-0969-43d5-9295-53e15db24257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:46 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Volume volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee (8026340c-737a-43b4-9fd5-0ada3da3a4ee): created successfully Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133be053-0969-43d5-9295-53e15db24257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Flow 'volume_create_manager' (ad41f76a-4918-436d-aea5-dc96c827edc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6b3f4ed3-76d8-483a-9ef1-b565bf750f76 tempest-AttachVolumeNegativeTest-1708897972 None] Created volume successfully. Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4c63b2-b345-401f-9b11-09b411afc84b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:47 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 Nov 01 12:29:47 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:47 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026" returned: 0 in 0.413s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:47 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65ec48c-3df7-4c5f-800f-ee35afebb280]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:47 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 Nov 01 12:29:47 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-5d713645-3054-4195-99af-15a7601b7933 req-50aef6cf-1395-4b4c-bad3-1e86c8d244a1 tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:47 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026" returned: 0 in 0.460s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:47 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img Nov 01 12:29:47 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-80c5645f-157a-43b6-8a5f-490199c93bb1 req-d3c81ce7-5e49-4d2c-84c9-6dedb5060a7b tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:53 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img" returned: 0 in 5.917s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[912f625e-c2fa-40f3-b9ad-1986602c3561]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:53 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 Nov 01 12:29:53 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:54 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026" returned: 0 in 0.514s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:54 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:29:54 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Converted 1024.00 MB image at 173.04 MB/s Nov 01 12:29:54 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] bf4d4118-05b4-431a-a737-ea600502ee16 was raw, converting to qcow2 {{(pid=86812) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 01 12:29:54 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d56944-4144-47d4-ba17-8a0476a6b0b6]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:54 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img Nov 01 12:29:54 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:54 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img" returned: 0 in 0.314s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:54 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img Nov 01 12:29:54 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:54 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img" returned: 1 in 0.311s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:29:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img /opt/stack/data/cinder/conversion/vol_upload_2ma7ajvc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:54 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img /opt/stack/data/cinder/conversion/vol_upload_2ma7ajvc Nov 01 12:29:54 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:55 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img /opt/stack/data/cinder/conversion/vol_upload_2ma7ajvc" returned: 0 in 0.249s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:55 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Image conversion details: src /opt/stack/data/cinder/conversion/b1bfca15-307f-4c84-b61b-5bbcc667b026.temp_image.bf4d4118-05b4-431a-a737-ea600502ee16a9i420it.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2ma7ajvc {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:29:55 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 01 12:29:55 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1d0391-552b-4a98-8bd2-2228f3804a70]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2ma7ajvc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:55 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2ma7ajvc Nov 01 12:29:55 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:55 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2ma7ajvc" returned: 0 in 0.319s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.788s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Uploaded volume to glance image-id: bf4d4118-05b4-431a-a737-ea600502ee16. {{(pid=86812) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 12:29:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-5d713645-3054-4195-99af-15a7601b7933 req-50aef6cf-1395-4b4c-bad3-1e86c8d244a1 tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.962s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-5d713645-3054-4195-99af-15a7601b7933 req-50aef6cf-1395-4b4c-bad3-1e86c8d244a1 tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-80c5645f-157a-43b6-8a5f-490199c93bb1 req-d3c81ce7-5e49-4d2c-84c9-6dedb5060a7b tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.432s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-11b3c883-7b49-4518-9e7c-929a6d37720f tempest-VolumesActionsTest-735104446 None] Copy volume to image completed successfully. Nov 01 12:29:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-80c5645f-157a-43b6-8a5f-490199c93bb1 req-d3c81ce7-5e49-4d2c-84c9-6dedb5060a7b tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-5d713645-3054-4195-99af-15a7601b7933 req-50aef6cf-1395-4b4c-bad3-1e86c8d244a1 tempest-AttachVolumeNegativeTest-1708897972 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4481b34-d3e6-42b9-a46b-ff4708213188', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:29:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-80c5645f-157a-43b6-8a5f-490199c93bb1 req-d3c81ce7-5e49-4d2c-84c9-6dedb5060a7b tempest-TestInstancesWithCinderVolumes-1349637665 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-da11a140-b120-46fd-a6ce-cefdd93bb055', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39faf511-2b84-4fc7-86a7-de3c355a64d2', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:29:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-5d713645-3054-4195-99af-15a7601b7933 req-50aef6cf-1395-4b4c-bad3-1e86c8d244a1 tempest-AttachVolumeNegativeTest-1708897972 None] attachment_update completed successfully. Nov 01 12:29:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-80c5645f-157a-43b6-8a5f-490199c93bb1 req-d3c81ce7-5e49-4d2c-84c9-6dedb5060a7b tempest-TestInstancesWithCinderVolumes-1349637665 None] attachment_update completed successfully. Nov 01 12:29:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Acquiring lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Acquiring lock "cinder-quobyte-b1bfca15-307f-4c84-b61b-5bbcc667b026" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Lock "cinder-quobyte-b1bfca15-307f-4c84-b61b-5bbcc667b026" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:58 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb80176f-a66a-476b-ad1e-696a231dbcd6]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:58 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 Nov 01 12:29:58 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:58 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026" returned: 0 in 0.413s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:58 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026 Nov 01 12:29:58 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:58 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b1bfca15-307f-4c84-b61b-5bbcc667b026" returned: 0 in 0.293s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Lock "cinder-quobyte-b1bfca15-307f-4c84-b61b-5bbcc667b026" released by "delete_volume" :: held 0.762s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:58 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Created reservations ['6af39f98-4860-454b-8f36-53f9541d2b08', '00b841aa-0de5-4ee1-8e75-959f54cdffdd', 'e548eacf-4faf-44cb-9a5c-3962e3aa9d65', '827253e1-efb4-4b0f-93b4-f7629f9a8653'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:59 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:29:59 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:59 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.288s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:59 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:59 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Deleted volume successfully. Nov 01 12:29:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ad52cc4-21f7-4542-9315-c537003d8f26 tempest-VolumesActionsTest-735104446 None] Lock "cinder-b1bfca15-307f-4c84-b61b-5bbcc667b026-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:02 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-54e66be9-ec24-46c0-a4f7-06863029d462 req-d0e98340-80df-40cf-8767-40f7585ee16e tempest-TestInstancesWithCinderVolumes-1349637665 None] Terminate volume connection completed successfully. Nov 01 12:30:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-54e66be9-ec24-46c0-a4f7-06863029d462 req-d0e98340-80df-40cf-8767-40f7585ee16e tempest-TestInstancesWithCinderVolumes-1349637665 None] Deleting attachment 96eec85e-3e4c-4d13-8945-a1354814e544. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:30:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "cinder-9d0789ac-3881-4544-ae6c-32da7067fdde-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-9d0789ac-3881-4544-ae6c-32da7067fdde-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "cinder-quobyte-9d0789ac-3881-4544-ae6c-32da7067fdde" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-quobyte-9d0789ac-3881-4544-ae6c-32da7067fdde" acquired by "delete_volume" :: waited 0.026s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:03 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7161da-c4d1-4739-a124-e489d43b11fd]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:04 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde Nov 01 12:30:04 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:04 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde" returned: 0 in 0.680s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:04 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde Nov 01 12:30:04 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:04 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-9d0789ac-3881-4544-ae6c-32da7067fdde" returned: 0 in 0.306s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-quobyte-9d0789ac-3881-4544-ae6c-32da7067fdde" released by "delete_volume" :: held 1.069s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:04 devstack cinder-volume[86812]: WARNING cinder.quota [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1514592934-378448387 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1514592934-378448387, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:30:04 devstack cinder-volume[86812]: WARNING cinder.quota [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1514592934-378448387 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1514592934-378448387, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Created reservations ['24534f46-727b-43a2-a220-037ed2e6ae5f', 'f0c8f280-edb9-4d65-9256-f9dcea1d3bd5', '64477331-8982-4112-987b-9b7b087cb77f', '24ff9b7e-9813-4c14-9de1-5d54a0f218c4'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:05 devstack sudo[98499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:30:05 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:05 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.341s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:05 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:05 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Deleted volume successfully. Nov 01 12:30:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef750078-01a6-499f-b7f5-95704456aed1 tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-9d0789ac-3881-4544-ae6c-32da7067fdde-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:08 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-eb8eb8bb-0c64-4a2f-9b5b-de96e769a56a req-32c0d66d-7675-4f3e-a712-ced25821a321 tempest-TestInstancesWithCinderVolumes-1349637665 None] Terminate volume connection completed successfully. Nov 01 12:30:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-eb8eb8bb-0c64-4a2f-9b5b-de96e769a56a req-32c0d66d-7675-4f3e-a712-ced25821a321 tempest-TestInstancesWithCinderVolumes-1349637665 None] Deleting attachment 39faf511-2b84-4fc7-86a7-de3c355a64d2. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "cinder-da11a140-b120-46fd-a6ce-cefdd93bb055-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-da11a140-b120-46fd-a6ce-cefdd93bb055-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "cinder-quobyte-da11a140-b120-46fd-a6ce-cefdd93bb055" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-quobyte-da11a140-b120-46fd-a6ce-cefdd93bb055" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d9ec36-ec88-4a50-ba37-c2a77872a1bf]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Flow 'volume_create_manager' (865949a4-742c-473e-965d-e810f8e79b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ad4833-991a-47e1-a090-9d94c46ca2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ad4833-991a-47e1-a090-9d94c46ca2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-127955520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08dcff4e-72f3-4d5a-b8d3-442379d31ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927c2b2a3ae94211b8ede08612389497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:10Z,use_quota=True,user_id='4d93c7befdb34dafa75cce4e3fcb145e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f709a8e-7f01-4807-a949-0e790066d677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f709a8e-7f01-4807-a949-0e790066d677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e87b232-b379-43a0-9d4a-be6482561416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e87b232-b379-43a0-9d4a-be6482561416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08dcff4e-72f3-4d5a-b8d3-442379d31ee8', 'volume_name': 'volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:09 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055 Nov 01 12:30:09 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f614ae92-b9e0-4745-8c5b-9c1221756752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f614ae92-b9e0-4745-8c5b-9c1221756752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e808e795-a3f3-4438-8942-c5374055fc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:09 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Volume 08dcff4e-72f3-4d5a-b8d3-442379d31ee8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8', 'volume_size': 1} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-127955520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08dcff4e-72f3-4d5a-b8d3-442379d31ee8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927c2b2a3ae94211b8ede08612389497',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:10Z,use_quota=True,user_id='4d93c7befdb34dafa75cce4e3fcb145e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Creating volume 08dcff4e-72f3-4d5a-b8d3-442379d31ee8 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:30:09 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:30:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:09 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8 1073741824 Nov 01 12:30:09 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:10 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055" returned: 0 in 0.602s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:10 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055 Nov 01 12:30:10 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:10 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-da11a140-b120-46fd-a6ce-cefdd93bb055" returned: 0 in 0.383s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-quobyte-da11a140-b120-46fd-a6ce-cefdd93bb055" released by "delete_volume" :: held 1.137s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:10 devstack cinder-volume[86812]: WARNING cinder.quota [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-645777700-1562698007 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-645777700-1562698007, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:30:10 devstack cinder-volume[86812]: WARNING cinder.quota [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-645777700-1562698007 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-645777700-1562698007, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Created reservations ['efdd8fbf-4a3c-42ec-b862-dfa27db5ae7e', '507297b3-faaa-4d39-a474-5e6fdd79e3d0', 'fc072e2f-9d13-40cf-8f97-34faec3f8e26', '64f7244d-138f-48ec-8f2e-7e5e931ae611'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:10 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8 1073741824" returned: 0 in 0.867s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:10 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8 Nov 01 12:30:10 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:10 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:30:10 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:11 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:11 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8" returned: 0 in 0.440s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:30:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.413s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:11 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Deleted volume successfully. Nov 01 12:30:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e808e795-a3f3-4438-8942-c5374055fc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793bc4b6-eab2-41e6-9f1d-8650aad67868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6fe0814b-dc7b-4751-a741-ab02e6afd94e tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-da11a140-b120-46fd-a6ce-cefdd93bb055-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:11 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Volume volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8 (08dcff4e-72f3-4d5a-b8d3-442379d31ee8): created successfully Nov 01 12:30:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793bc4b6-eab2-41e6-9f1d-8650aad67868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Flow 'volume_create_manager' (865949a4-742c-473e-965d-e810f8e79b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d6a9ab6a-553f-43f2-b6d9-b6fe52fa3095 tempest-VolumesNegativeTest-515065159 None] Created volume successfully. Nov 01 12:30:15 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-54856b2f-8e26-43e3-87a3-26335c65b7d8 req-ae1cf174-66da-421a-acd5-26ac4f5b50dd tempest-TestInstancesWithCinderVolumes-1349637665 None] Terminate volume connection completed successfully. Nov 01 12:30:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-54856b2f-8e26-43e3-87a3-26335c65b7d8 req-ae1cf174-66da-421a-acd5-26ac4f5b50dd tempest-TestInstancesWithCinderVolumes-1349637665 None] Deleting attachment 76802870-59a6-472b-8ed2-2ef050c6606d. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:30:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "cinder-1026c9e2-4344-4be5-8683-7f71f7fad7b3-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-1026c9e2-4344-4be5-8683-7f71f7fad7b3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "cinder-quobyte-1026c9e2-4344-4be5-8683-7f71f7fad7b3" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-quobyte-1026c9e2-4344-4be5-8683-7f71f7fad7b3" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:17 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a579377c-0043-41b0-bfea-f483a4a64028]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:17 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 Nov 01 12:30:17 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:18 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3" returned: 0 in 0.452s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:18 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3 Nov 01 12:30:18 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:18 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1026c9e2-4344-4be5-8683-7f71f7fad7b3" returned: 0 in 0.306s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-quobyte-1026c9e2-4344-4be5-8683-7f71f7fad7b3" released by "delete_volume" :: held 0.832s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:18 devstack cinder-volume[86812]: WARNING cinder.quota [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1570199181-56603347 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1570199181-56603347, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:30:18 devstack cinder-volume[86812]: WARNING cinder.quota [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1570199181-56603347 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1570199181-56603347, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Created reservations ['cb5ffc7a-ba1f-49a8-8b41-cbbe931830fc', 'bce9506d-47e2-42d2-b596-6adcc77db9da', '23f8a652-751b-4332-8289-395332005dd1', 'c0ba01c7-cd22-406f-91d4-ba5ccfb021fd'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:18 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:30:18 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:19 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.571s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:19 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:19 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Deleted volume successfully. Nov 01 12:30:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5ea1d067-bc2c-4f9c-94f6-2baf7cb81b8f tempest-TestInstancesWithCinderVolumes-1349637665 None] Lock "cinder-1026c9e2-4344-4be5-8683-7f71f7fad7b3-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:28 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=49,cinder:UPDATE=46,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:30:29 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=47,cinder:UPDATE=41,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:30:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Acquiring lock "cinder-08dcff4e-72f3-4d5a-b8d3-442379d31ee8-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Lock "cinder-08dcff4e-72f3-4d5a-b8d3-442379d31ee8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Acquiring lock "cinder-quobyte-08dcff4e-72f3-4d5a-b8d3-442379d31ee8" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Lock "cinder-quobyte-08dcff4e-72f3-4d5a-b8d3-442379d31ee8" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[126598a9-e061-474a-b107-3604631602c6]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:33 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8 Nov 01 12:30:33 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:33 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8" returned: 0 in 0.459s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:33 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8 Nov 01 12:30:33 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:33 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08dcff4e-72f3-4d5a-b8d3-442379d31ee8" returned: 0 in 0.263s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Lock "cinder-quobyte-08dcff4e-72f3-4d5a-b8d3-442379d31ee8" released by "delete_volume" :: held 0.785s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Created reservations ['785d0eb9-09fa-422c-975d-175da3d91c42', '08aeb986-ddad-44e5-aa82-fa61e2947c2a', '36ea3385-e56e-4dc8-adda-4eac135b6649', '005609a7-db66-48b8-b1f8-30cf03ed2760'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:34 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:30:34 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:34 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.318s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:34 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:34 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Deleted volume successfully. Nov 01 12:30:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-25b4c4f4-2a5d-49c4-9c5e-dfddb2cc08b8 tempest-VolumesNegativeTest-515065159 None] Lock "cinder-08dcff4e-72f3-4d5a-b8d3-442379d31ee8-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:36 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-9597d1ed-250a-44a7-8506-44e5f01cf78b req-441ad917-74c1-4343-9634-e269ffb288b2 tempest-AttachVolumeNegativeTest-1708897972 None] Terminate volume connection completed successfully. Nov 01 12:30:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-9597d1ed-250a-44a7-8506-44e5f01cf78b req-441ad917-74c1-4343-9634-e269ffb288b2 tempest-AttachVolumeNegativeTest-1708897972 None] Deleting attachment b4481b34-d3e6-42b9-a46b-ff4708213188. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:30:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:30:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:37 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:30:37 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:37 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.389s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:30:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:30:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:30:55 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=2 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:30:55 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Flow 'volume_create_manager' (86b1e570-88ca-402d-918b-835cee2e8d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84aa00e8-7e04-483a-9c35-7c31962d724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84aa00e8-7e04-483a-9c35-7c31962d724c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2110547435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1cd5f9-257c-4514-8544-e105ed207614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8162183521a94f729dc51c6e25df9a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:17Z,use_quota=True,user_id='16dc6f4c54df478281a32e7da026e92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1aaa4f4-9b85-4677-811d-fb004082ec50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1aaa4f4-9b85-4677-811d-fb004082ec50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bab2235-5f63-4c1d-bccb-d8d7eb88cd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bab2235-5f63-4c1d-bccb-d8d7eb88cd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1cd5f9-257c-4514-8544-e105ed207614', 'volume_name': 'volume-5b1cd5f9-257c-4514-8544-e105ed207614', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52174579-4758-417d-a452-ff3b6586bdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52174579-4758-417d-a452-ff3b6586bdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc17fa6a-798e-49d1-88c6-5dc8ab4c0f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:17 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Volume 5b1cd5f9-257c-4514-8544-e105ed207614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1cd5f9-257c-4514-8544-e105ed207614', 'volume_size': 1} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2110547435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1cd5f9-257c-4514-8544-e105ed207614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8162183521a94f729dc51c6e25df9a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:17Z,use_quota=True,user_id='16dc6f4c54df478281a32e7da026e92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Creating volume 5b1cd5f9-257c-4514-8544-e105ed207614 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:17 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:31:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:17 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614 1073741824 Nov 01 12:31:17 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:18 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614 1073741824" returned: 0 in 0.502s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:18 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614 Nov 01 12:31:18 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:18 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614" returned: 0 in 0.284s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc17fa6a-798e-49d1-88c6-5dc8ab4c0f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1cd5f9-257c-4514-8544-e105ed207614', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e01cb-c4bc-453b-8512-39fc4ab8b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:18 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Volume volume-5b1cd5f9-257c-4514-8544-e105ed207614 (5b1cd5f9-257c-4514-8544-e105ed207614): created successfully Nov 01 12:31:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c3e01cb-c4bc-453b-8512-39fc4ab8b24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Flow 'volume_create_manager' (86b1e570-88ca-402d-918b-835cee2e8d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:18 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-abbe94a5-e711-47eb-84bf-e54b53722001 tempest-AttachVolumeNegativeTest-1708897972 None] Created volume successfully. Nov 01 12:31:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-808e3f0c-3fe2-44c1-bf56-fbdf1dddef89 req-9ed5cf8e-7d3d-4967-9aad-31e1f1f9c4fd tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-808e3f0c-3fe2-44c1-bf56-fbdf1dddef89 req-9ed5cf8e-7d3d-4967-9aad-31e1f1f9c4fd tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-808e3f0c-3fe2-44c1-bf56-fbdf1dddef89 req-9ed5cf8e-7d3d-4967-9aad-31e1f1f9c4fd tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-808e3f0c-3fe2-44c1-bf56-fbdf1dddef89 req-9ed5cf8e-7d3d-4967-9aad-31e1f1f9c4fd tempest-AttachVolumeNegativeTest-1708897972 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-5b1cd5f9-257c-4514-8544-e105ed207614', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6cb9755-3a04-4092-bd62-ca5dc998bfa4', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:31:20 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-808e3f0c-3fe2-44c1-bf56-fbdf1dddef89 req-9ed5cf8e-7d3d-4967-9aad-31e1f1f9c4fd tempest-AttachVolumeNegativeTest-1708897972 None] attachment_update completed successfully. Nov 01 12:31:21 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-d360d4c9-1d83-4b2a-ae7c-6222125a888e req-6a961864-538b-4f60-ab79-19afcad2eb0c tempest-AttachVolumeNegativeTest-1708897972 None] Terminate volume connection completed successfully. Nov 01 12:31:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-d360d4c9-1d83-4b2a-ae7c-6222125a888e req-6a961864-538b-4f60-ab79-19afcad2eb0c tempest-AttachVolumeNegativeTest-1708897972 None] Deleting attachment d6cb9755-3a04-4092-bd62-ca5dc998bfa4. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Flow 'volume_create_manager' (4b8a56e7-da7e-487d-badb-acd17525ce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c9357f-9bfe-4ceb-a3a7-3fbf7f60bc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c9357f-9bfe-4ceb-a3a7-3fbf7f60bc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2060106289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b016d7f6-7060-4a9c-92f0-3c2d35f836b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be513b34964641d991183ba7c5448116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:29Z,use_quota=True,user_id='e518e72b3fd14da5a5a540a1cbb2f532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3cbde1-3e2a-4cac-87ab-49ec522663bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3cbde1-3e2a-4cac-87ab-49ec522663bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da115d4-e915-4949-be1d-fa7fc9a47f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da115d4-e915-4949-be1d-fa7fc9a47f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b016d7f6-7060-4a9c-92f0-3c2d35f836b7', 'volume_name': 'volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2b80df-57ca-4afb-ac1d-4463d53804c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b2b80df-57ca-4afb-ac1d-4463d53804c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feab6c5e-2fa5-4156-b2d5-bfa7e20bacd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:28 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Volume b016d7f6-7060-4a9c-92f0-3c2d35f836b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7', 'volume_size': 1} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2060106289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b016d7f6-7060-4a9c-92f0-3c2d35f836b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be513b34964641d991183ba7c5448116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:29Z,use_quota=True,user_id='e518e72b3fd14da5a5a540a1cbb2f532',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Creating volume b016d7f6-7060-4a9c-92f0-3c2d35f836b7 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:28 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:31:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:28 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7 1073741824 Nov 01 12:31:28 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:29 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7 1073741824" returned: 0 in 0.493s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:29 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7 Nov 01 12:31:29 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:29 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7" returned: 0 in 0.262s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feab6c5e-2fa5-4156-b2d5-bfa7e20bacd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32f633d-453a-4728-bdcc-99e001beb76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:29 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Volume volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7 (b016d7f6-7060-4a9c-92f0-3c2d35f836b7): created successfully Nov 01 12:31:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f32f633d-453a-4728-bdcc-99e001beb76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Flow 'volume_create_manager' (4b8a56e7-da7e-487d-badb-acd17525ce4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:29 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8d0ec02b-87b5-4299-b6c7-f0560ef042c1 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Created volume successfully. Nov 01 12:31:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-431f4ae5-0a87-419f-a343-f9f40d3cde87 req-145e915f-31b2-42d9-abff-6cb4ebf35e37 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-431f4ae5-0a87-419f-a343-f9f40d3cde87 req-145e915f-31b2-42d9-abff-6cb4ebf35e37 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-431f4ae5-0a87-419f-a343-f9f40d3cde87 req-145e915f-31b2-42d9-abff-6cb4ebf35e37 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-431f4ae5-0a87-419f-a343-f9f40d3cde87 req-145e915f-31b2-42d9-abff-6cb4ebf35e37 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2175a36-ed72-400a-8285-da0e39297579', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:31:31 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-431f4ae5-0a87-419f-a343-f9f40d3cde87 req-145e915f-31b2-42d9-abff-6cb4ebf35e37 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] attachment_update completed successfully. Nov 01 12:31:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-1c85b128-f960-4e8e-93dc-a2c6ddd4aad5 req-8b0accce-75c6-49fa-97ef-adacb342185f tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Terminate volume connection completed successfully. Nov 01 12:31:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-1c85b128-f960-4e8e-93dc-a2c6ddd4aad5 req-8b0accce-75c6-49fa-97ef-adacb342185f tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Deleting attachment a2175a36-ed72-400a-8285-da0e39297579. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Acquiring lock "cinder-b016d7f6-7060-4a9c-92f0-3c2d35f836b7-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "cinder-b016d7f6-7060-4a9c-92f0-3c2d35f836b7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Acquiring lock "cinder-quobyte-b016d7f6-7060-4a9c-92f0-3c2d35f836b7" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "cinder-quobyte-b016d7f6-7060-4a9c-92f0-3c2d35f836b7" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d95906-5438-4a70-a79e-af4d4deba7be]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:36 devstack sudo[100176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7 Nov 01 12:31:36 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:36 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7" returned: 0 in 0.439s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:36 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7 Nov 01 12:31:36 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:37 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:31:37 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:37 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b016d7f6-7060-4a9c-92f0-3c2d35f836b7" returned: 0 in 0.319s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "cinder-quobyte-b016d7f6-7060-4a9c-92f0-3c2d35f836b7" released by "delete_volume" :: held 0.853s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Created reservations ['eba7821d-5045-4de4-bb3b-422b72525e87', 'a04f9ea3-9061-4230-9dc9-46e9d0c621eb', '5aade3f7-f466-4b12-bdce-c38534ea7a7a', '15dcefa2-bc02-44be-8996-105b2138ca78'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:37 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.346s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:31:37 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:31:37 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:37 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.337s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:37 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Deleted volume successfully. Nov 01 12:31:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-83080a11-7065-450f-9f0d-bfd2d4bd8376 tempest-TestServerVolumeAttachScenarioOldVersion-1816677114 None] Lock "cinder-b016d7f6-7060-4a9c-92f0-3c2d35f836b7-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:47 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=27,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:31:47 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=21,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Flow 'volume_create_manager' (73d7a835-cb51-412d-b081-5281eba68ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de1d2ce-8b84-4a8b-9feb-030958064666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de1d2ce-8b84-4a8b-9feb-030958064666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-5345578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab952e6a-e67b-4a94-83ad-99b0ae96e028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8162183521a94f729dc51c6e25df9a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:57Z,use_quota=True,user_id='16dc6f4c54df478281a32e7da026e92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26733760-49bd-4127-abc0-ae97b387635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26733760-49bd-4127-abc0-ae97b387635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d417795-85c3-4cfd-814a-2531b639ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d417795-85c3-4cfd-814a-2531b639ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab952e6a-e67b-4a94-83ad-99b0ae96e028', 'volume_name': 'volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19fdb58-333a-4383-af76-259729c7805b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19fdb58-333a-4383-af76-259729c7805b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9486cb-2b8a-4008-b6be-bd772c478cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:56 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Volume ab952e6a-e67b-4a94-83ad-99b0ae96e028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028', 'volume_size': 1} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-5345578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab952e6a-e67b-4a94-83ad-99b0ae96e028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8162183521a94f729dc51c6e25df9a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:57Z,use_quota=True,user_id='16dc6f4c54df478281a32e7da026e92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Creating volume ab952e6a-e67b-4a94-83ad-99b0ae96e028 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:56 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:31:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:57 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028 1073741824 Nov 01 12:31:57 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:57 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028 1073741824" returned: 0 in 0.571s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:57 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028 Nov 01 12:31:57 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:57 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9486cb-2b8a-4008-b6be-bd772c478cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ca4158-5687-4cc5-9def-91cf4a6ff4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:57 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Volume volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028 (ab952e6a-e67b-4a94-83ad-99b0ae96e028): created successfully Nov 01 12:31:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ca4158-5687-4cc5-9def-91cf4a6ff4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Flow 'volume_create_manager' (73d7a835-cb51-412d-b081-5281eba68ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:57 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e11b1dd7-d4d3-452a-b77f-9bb948406ceb tempest-AttachVolumeNegativeTest-1708897972 None] Created volume successfully. Nov 01 12:31:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-cae67a0f-ccd0-478b-8d3e-cd52226dbc50 req-6b2a40dd-710a-44af-91b7-f82d7b12cafa tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-cae67a0f-ccd0-478b-8d3e-cd52226dbc50 req-6b2a40dd-710a-44af-91b7-f82d7b12cafa tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-cae67a0f-ccd0-478b-8d3e-cd52226dbc50 req-6b2a40dd-710a-44af-91b7-f82d7b12cafa tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-cae67a0f-ccd0-478b-8d3e-cd52226dbc50 req-6b2a40dd-710a-44af-91b7-f82d7b12cafa tempest-AttachVolumeNegativeTest-1708897972 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3166021-f3d0-4f2f-997e-cff7be2164c5', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:31:59 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-cae67a0f-ccd0-478b-8d3e-cd52226dbc50 req-6b2a40dd-710a-44af-91b7-f82d7b12cafa tempest-AttachVolumeNegativeTest-1708897972 None] attachment_update completed successfully. Nov 01 12:32:02 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-7b6b66fd-be7c-4272-a496-4c069a1a236f req-46d9db1f-affa-41d2-8366-10ba00fec80e tempest-AttachVolumeNegativeTest-1708897972 None] Terminate volume connection completed successfully. Nov 01 12:32:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-7b6b66fd-be7c-4272-a496-4c069a1a236f req-46d9db1f-affa-41d2-8366-10ba00fec80e tempest-AttachVolumeNegativeTest-1708897972 None] Deleting attachment f3166021-f3d0-4f2f-997e-cff7be2164c5. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:32:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "cinder-ab952e6a-e67b-4a94-83ad-99b0ae96e028-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-ab952e6a-e67b-4a94-83ad-99b0ae96e028-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "cinder-quobyte-ab952e6a-e67b-4a94-83ad-99b0ae96e028" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-quobyte-ab952e6a-e67b-4a94-83ad-99b0ae96e028" acquired by "delete_volume" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3333a6a-555c-4f9c-b5cf-b934598afebd]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:08 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028 Nov 01 12:32:08 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:08 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028" returned: 0 in 0.420s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:08 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028 Nov 01 12:32:08 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:08 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ab952e6a-e67b-4a94-83ad-99b0ae96e028" returned: 0 in 0.304s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-quobyte-ab952e6a-e67b-4a94-83ad-99b0ae96e028" released by "delete_volume" :: held 0.825s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Created reservations ['697f4151-6928-4fc4-affa-54211de9d897', '36539e9e-f678-41f2-bc11-55e995b70dc0', '0f8310d6-cb04-478c-9d1a-cd0fd2d452e2', 'c5975ce2-405e-452b-aa7f-28bab841fa8b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:09 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:32:09 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "cinder-5b1cd5f9-257c-4514-8544-e105ed207614-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-5b1cd5f9-257c-4514-8544-e105ed207614-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:09 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.325s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "cinder-quobyte-5b1cd5f9-257c-4514-8544-e105ed207614" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Deleted volume successfully. Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-quobyte-5b1cd5f9-257c-4514-8544-e105ed207614" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8bd82f77-8159-4aa1-9799-e52786d43fcf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-ab952e6a-e67b-4a94-83ad-99b0ae96e028-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b513c4af-a929-4515-bf28-4fec5fc293f7]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:09 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614 Nov 01 12:32:09 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:10 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614" returned: 0 in 0.408s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:10 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614 Nov 01 12:32:10 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:10 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Flow 'volume_create_manager' (df8de764-a9de-4aea-b98e-4ee1bc608039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe6148e-e4a8-4f30-8502-d22263d672b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5b1cd5f9-257c-4514-8544-e105ed207614" returned: 0 in 0.357s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe6148e-e4a8-4f30-8502-d22263d672b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-96863059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ed90a9-657e-4b6a-8c3d-16f2049cd554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb9b3e5aca44c9c9afbed6d486532c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:10Z,use_quota=True,user_id='14cf38cb04414e178050f9e5ed36479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723cd981-05b8-4e35-b723-a18b8b6f58ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723cd981-05b8-4e35-b723-a18b8b6f58ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ede82e-8982-4175-98c3-186608d68cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15ede82e-8982-4175-98c3-186608d68cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ed90a9-657e-4b6a-8c3d-16f2049cd554', 'volume_name': 'volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3d1ff9-84d9-4eed-b8aa-7ebbef4a6567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3d1ff9-84d9-4eed-b8aa-7ebbef4a6567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfc8b5d-b890-470b-9bd3-9d94ed15119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:10 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Volume 37ed90a9-657e-4b6a-8c3d-16f2049cd554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554', 'volume_size': 1} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-96863059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ed90a9-657e-4b6a-8c3d-16f2049cd554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb9b3e5aca44c9c9afbed6d486532c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:10Z,use_quota=True,user_id='14cf38cb04414e178050f9e5ed36479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Creating volume 37ed90a9-657e-4b6a-8c3d-16f2049cd554 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:10 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-quobyte-5b1cd5f9-257c-4514-8544-e105ed207614" released by "delete_volume" :: held 0.888s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:10 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554 1073741824 Nov 01 12:32:10 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Created reservations ['9c217bd3-e736-49bc-b34f-24f2f110e6f2', 'c11d8013-0b8e-408f-bb73-399c2aca8a95', '33e9686a-976d-46e1-b039-0b405220aa29', '0a61ac7d-e356-480b-b866-d0480199781f'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Flow 'volume_create_manager' (f1124d0d-0769-4b6e-8fdc-adf5bedb5de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b23d20d-bcf3-4714-b0cb-2fa291181611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b23d20d-bcf3-4714-b0cb-2fa291181611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1006551322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a070e7d0-ab26-4a73-ba56-ae5300b019f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb9b3e5aca44c9c9afbed6d486532c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:11Z,use_quota=True,user_id='14cf38cb04414e178050f9e5ed36479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a0c517-3af9-425c-8e8b-ee169ed3463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a0c517-3af9-425c-8e8b-ee169ed3463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920043d5-007b-4961-a033-7b1f543b656c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920043d5-007b-4961-a033-7b1f543b656c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a070e7d0-ab26-4a73-ba56-ae5300b019f3', 'volume_name': 'volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e615ae-86ff-4cf3-884a-1a90589561b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e615ae-86ff-4cf3-884a-1a90589561b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c50ef67-e9a4-45fa-9d26-6010430540c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:10 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Volume a070e7d0-ab26-4a73-ba56-ae5300b019f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3', 'volume_size': 1} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:10 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:32:10 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:11 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554 1073741824" returned: 0 in 0.623s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:11 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.297s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:32:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Deleted volume successfully. Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6056a8c-e71c-46ec-ab65-7c2731c18ecf tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-5b1cd5f9-257c-4514-8544-e105ed207614-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:11 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554 Nov 01 12:32:11 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:11 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1006551322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a070e7d0-ab26-4a73-ba56-ae5300b019f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb9b3e5aca44c9c9afbed6d486532c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:11Z,use_quota=True,user_id='14cf38cb04414e178050f9e5ed36479c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Creating volume a070e7d0-ab26-4a73-ba56-ae5300b019f3 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:11 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cfc8b5d-b890-470b-9bd3-9d94ed15119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:11 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3 1073741824 Nov 01 12:32:11 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037e353c-e8f6-4cb4-a619-3f445b339a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:11 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Volume volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554 (37ed90a9-657e-4b6a-8c3d-16f2049cd554): created successfully Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (037e353c-e8f6-4cb4-a619-3f445b339a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Flow 'volume_create_manager' (df8de764-a9de-4aea-b98e-4ee1bc608039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-376f5906-c489-4a05-8594-d39266ac0349 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Created volume successfully. Nov 01 12:32:11 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3 1073741824" returned: 0 in 0.532s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "cinder-8026340c-737a-43b4-9fd5-0ada3da3a4ee-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-8026340c-737a-43b4-9fd5-0ada3da3a4ee-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:12 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3 Nov 01 12:32:12 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "cinder-quobyte-8026340c-737a-43b4-9fd5-0ada3da3a4ee" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-quobyte-8026340c-737a-43b4-9fd5-0ada3da3a4ee" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb59a43-7fb1-4299-a535-398e39d6bae0]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:12 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee Nov 01 12:32:12 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:12 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3" returned: 0 in 0.269s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c50ef67-e9a4-45fa-9d26-6010430540c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886c4bb0-ec82-4837-b7d9-0aaaf46494e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:12 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Volume volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3 (a070e7d0-ab26-4a73-ba56-ae5300b019f3): created successfully Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (886c4bb0-ec82-4837-b7d9-0aaaf46494e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Flow 'volume_create_manager' (f1124d0d-0769-4b6e-8fdc-adf5bedb5de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:12 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-43fcb844-e719-4606-a149-17cf4645e175 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Created volume successfully. Nov 01 12:32:12 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee" returned: 0 in 0.399s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:12 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee Nov 01 12:32:12 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:12 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8026340c-737a-43b4-9fd5-0ada3da3a4ee" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-quobyte-8026340c-737a-43b4-9fd5-0ada3da3a4ee" released by "delete_volume" :: held 0.701s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Created reservations ['ef24afb3-006d-4242-bf01-4bfd98240c39', '39f128be-ec8e-49e3-b25d-d5b0476f3ce5', '5b314934-4b29-4577-94b5-cdbd12e9ee68', 'b4a93a44-7edc-40a2-b8b8-0a512bc08ff4'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:12 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:32:12 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:13 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.265s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:13 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:32:13 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Deleted volume successfully. Nov 01 12:32:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bffa234-fc41-4799-8d17-cec58c9fc13f tempest-AttachVolumeNegativeTest-1708897972 None] Lock "cinder-8026340c-737a-43b4-9fd5-0ada3da3a4ee-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:22 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=37,cinder:SELECT=25,cinder:INSERT=10 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:32:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6e58aef6-505e-41e1-954b-2eac813fbca6 tempest-GroupSnapshotsTest-1216919171 None] Group tempest-GroupSnapshotsTest-Group-1184816253: creating Nov 01 12:32:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6e58aef6-505e-41e1-954b-2eac813fbca6 tempest-GroupSnapshotsTest-1216919171 None] Group tempest-GroupSnapshotsTest-Group-1184816253: created successfully Nov 01 12:32:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6e58aef6-505e-41e1-954b-2eac813fbca6 tempest-GroupSnapshotsTest-1216919171 None] Create group completed successfully. Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Flow 'volume_create_manager' (183feae0-04af-4850-b98e-08467c3c4ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26bf040-5751-458e-9732-fbf41e563072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26bf040-5751-458e-9732-fbf41e563072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1989652371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=278d64eb-6305-4342-97ac-c3866245ed8a,host='devstack@QuobyteHD#QuobyteHD',id=1da9baea-84d5-4d65-8875-dfce57c96ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a893c5adfa472aa7a8fe96ae1d29ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:25Z,use_quota=True,user_id='a7c5dc1c79224b7a8c83826c2e678f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcf22a7d-556a-4439-830b-1e6f24bedd56),volume_type_id=bcf22a7d-556a-4439-830b-1e6f24bedd56)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99fec77-6cb4-49a5-8237-c05937dacf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99fec77-6cb4-49a5-8237-c05937dacf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ae5ee2-0975-4aa2-ae5d-5ee87cd358db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ae5ee2-0975-4aa2-ae5d-5ee87cd358db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1da9baea-84d5-4d65-8875-dfce57c96ae3', 'volume_name': 'volume-1da9baea-84d5-4d65-8875-dfce57c96ae3', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4f53a3-c9cd-477a-88ff-51d748c3f42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4f53a3-c9cd-477a-88ff-51d748c3f42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc070f2e-2233-4b1f-bf73-e27fd245ef3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:24 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Volume 1da9baea-84d5-4d65-8875-dfce57c96ae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1da9baea-84d5-4d65-8875-dfce57c96ae3', 'volume_size': 1} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=278d64eb-6305-4342-97ac-c3866245ed8a,created_at=2026-11-01T11:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1989652371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=278d64eb-6305-4342-97ac-c3866245ed8a,host='devstack@QuobyteHD#QuobyteHD',id=1da9baea-84d5-4d65-8875-dfce57c96ae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a893c5adfa472aa7a8fe96ae1d29ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:25Z,use_quota=True,user_id='a7c5dc1c79224b7a8c83826c2e678f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcf22a7d-556a-4439-830b-1e6f24bedd56),volume_type_id=bcf22a7d-556a-4439-830b-1e6f24bedd56)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Creating volume 1da9baea-84d5-4d65-8875-dfce57c96ae3 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:24 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:32:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:24 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 1073741824 Nov 01 12:32:24 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:25 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 1073741824" returned: 0 in 0.452s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:25 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 Nov 01 12:32:25 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:25 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3" returned: 0 in 0.276s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:32:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc070f2e-2233-4b1f-bf73-e27fd245ef3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da9baea-84d5-4d65-8875-dfce57c96ae3', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad241f7-6d19-43b3-b03c-78d7bf0199f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Volume volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 (1da9baea-84d5-4d65-8875-dfce57c96ae3): created successfully Nov 01 12:32:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad241f7-6d19-43b3-b03c-78d7bf0199f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Flow 'volume_create_manager' (183feae0-04af-4850-b98e-08467c3c4ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-108b3d73-3273-4e76-8203-40379a80eec3 tempest-GroupSnapshotsTest-1216919171 None] Created volume successfully. Nov 01 12:32:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] GroupSnapshot 6a97c5f9-49c0-423f-bf6d-24f081d37147: creating. Nov 01 12:32:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Group snapshot 6a97c5f9-49c0-423f-bf6d-24f081d37147: creating. {{(pid=86812) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 12:32:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Creating offline snapshot b29ebc74-3781-4559-9a03-4940eabd3c06 of volume 1da9baea-84d5-4d65-8875-dfce57c96ae3 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:32:26 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61cf583-0dd7-44ff-a952-4ba23b334ab0]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:26 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 Nov 01 12:32:26 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:26 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3" returned: 0 in 0.376s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:26 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 1G Nov 01 12:32:26 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:26 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 1G" returned: 0 in 0.401s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:26 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 Nov 01 12:32:26 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:27 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06" returned: 0 in 0.324s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:27 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:32:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:27 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 Nov 01 12:32:27 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:27 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:27 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.info Nov 01 12:32:27 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:27 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.info" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:27 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:32:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:27 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.info Nov 01 12:32:27 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:27 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.info" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a4553fe7-a6f6-4896-9f2e-696453c284e7 tempest-GroupSnapshotsTest-1216919171 None] group_snapshot 6a97c5f9-49c0-423f-bf6d-24f081d37147: created successfully Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-b29ebc74-3781-4559-9a03-4940eabd3c06-af7fdfe4-d34e-4165-80ab-2da372481bbc" by "_create_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-b29ebc74-3781-4559-9a03-4940eabd3c06-af7fdfe4-d34e-4165-80ab-2da372481bbc" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Creating volume af7fdfe4-d34e-4165-80ab-2da372481bbc from snapshot b29ebc74-3781-4559-9a03-4940eabd3c06 {{(pid=86812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-af7fdfe4-d34e-4165-80ab-2da372481bbc" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-af7fdfe4-d34e-4165-80ab-2da372481bbc" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] snapshot: b29ebc74-3781-4559-9a03-4940eabd3c06, volume: af7fdfe4-d34e-4165-80ab-2da372481bbc, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0dfb95-1643-4ee1-a11c-053ec852a454]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:29 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 Nov 01 12:32:29 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:29 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06" returned: 0 in 0.410s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1da9baea-84d5-4d65-8875-dfce57c96ae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:32:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbe0626-063a-4398-b41d-23bee4c90759]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:29 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 Nov 01 12:32:29 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:29 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3" returned: 0 in 0.365s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:32:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:32:29 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:32:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:29 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc Nov 01 12:32:29 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:36 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc" returned: 0 in 6.363s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:32:36 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Converted 1024.00 MB image at 160.91 MB/s Nov 01 12:32:36 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:36 devstack sudo[101006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc Nov 01 12:32:36 devstack sudo[101006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:36 devstack sudo[101006]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc" returned: 0 in 0.230s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-af7fdfe4-d34e-4165-80ab-2da372481bbc" released by "_copy_volume_from_snapshot" :: held 7.472s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-b29ebc74-3781-4559-9a03-4940eabd3c06-af7fdfe4-d34e-4165-80ab-2da372481bbc" released by "_create_volume_from_snapshot" :: held 7.547s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.565s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:36 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-111f2742-cd6f-44d8-bb84-f4094fcf7c10 tempest-GroupSnapshotsTest-1216919171 None] Create group from source-snapshot-6a97c5f9-49c0-423f-bf6d-24f081d37147 completed successfully. Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-af7fdfe4-d34e-4165-80ab-2da372481bbc" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-af7fdfe4-d34e-4165-80ab-2da372481bbc" acquired by "delete_volume" :: waited 0.036s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:36 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:32:37 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcb2ee0-025b-4ad1-a276-eac698bf441f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:37 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc Nov 01 12:32:37 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:37 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:32:37 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc" returned: 0 in 0.371s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:37 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc Nov 01 12:32:37 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:37 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-af7fdfe4-d34e-4165-80ab-2da372481bbc" returned: 0 in 0.234s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-af7fdfe4-d34e-4165-80ab-2da372481bbc" released by "delete_volume" :: held 0.656s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['e3fc750d-8f97-4ca7-adb3-dbbef3bdac56'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:37 devstack cinder-volume[86812]: WARNING cinder.quota [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-903548089 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-903548089, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:32:37 devstack cinder-volume[86812]: WARNING cinder.quota [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-903548089 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-903548089, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['ca7bcb95-9d3c-4845-866d-2ef331771359', 'afbbff1b-4437-4be8-933f-d93ab9742488', '6a3dd59c-1472-4fc9-ada4-0841c3676f0e', '5ebbfb99-c385-45da-b382-48c86c719aa2'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:37 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:32:37 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:38 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:32:38 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-25f50f21-02d3-4573-8e27-c86a3b322030 tempest-GroupSnapshotsTest-1216919171 None] Delete group completed successfully. Nov 01 12:32:38 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] group_snapshot 6a97c5f9-49c0-423f-bf6d-24f081d37147: deleting Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] group_snapshot 6a97c5f9-49c0-423f-bf6d-24f081d37147: deleting {{(pid=86812) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-1da9baea-84d5-4d65-8875-dfce57c96ae3" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-1da9baea-84d5-4d65-8875-dfce57c96ae3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-b29ebc74-3781-4559-9a03-4940eabd3c06" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-b29ebc74-3781-4559-9a03-4940eabd3c06" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Deleting offline snapshot b29ebc74-3781-4559-9a03-4940eabd3c06 of volume 1da9baea-84d5-4d65-8875-dfce57c96ae3 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] snapshot_file for this snap is: volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ee7dd3-b7ea-4aaa-a174-48120d624d85]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:38 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 Nov 01 12:32:38 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:38 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06" returned: 0 in 0.400s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1da9baea-84d5-4d65-8875-dfce57c96ae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f561a7-00ee-438a-bb0d-33b5c0bc98da]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:38 devstack sudo[101029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 Nov 01 12:32:38 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:39 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3" returned: 0 in 0.544s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:39 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 Nov 01 12:32:39 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:39 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06" returned: 0 in 0.331s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:39 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06 Nov 01 12:32:39 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:39 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3.b29ebc74-3781-4559-9a03-4940eabd3c06" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-b29ebc74-3781-4559-9a03-4940eabd3c06" released by "_delete_snapshot" :: held 1.645s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-1da9baea-84d5-4d65-8875-dfce57c96ae3" released by "delete_snapshot" :: held 1.667s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:39 devstack cinder-volume[86812]: WARNING cinder.quota [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-903548089 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-903548089, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:32:40 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['56ecd836-45bc-4559-bfb3-d23ea582b294', 'd167dd8c-9e11-4dac-a11e-635f3e04d98a', '29205cd2-6d14-4d72-a49d-6f12c57f7010', 'c98765cf-a192-4a8f-8d41-9f4c22bdc240'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:40 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d1e18d93-e5c8-4da3-8aba-e7e7a17b5bf0 tempest-GroupSnapshotsTest-1216919171 None] group_snapshot 6a97c5f9-49c0-423f-bf6d-24f081d37147: deleted successfully Nov 01 12:32:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-1da9baea-84d5-4d65-8875-dfce57c96ae3" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-1da9baea-84d5-4d65-8875-dfce57c96ae3" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:40 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dc060f-2c6a-4fa6-9281-b76573b314c9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:40 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 Nov 01 12:32:40 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:41 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3" returned: 0 in 0.373s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:41 devstack sudo[101049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3 Nov 01 12:32:41 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:41 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1da9baea-84d5-4d65-8875-dfce57c96ae3" returned: 0 in 0.243s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-1da9baea-84d5-4d65-8875-dfce57c96ae3" released by "delete_volume" :: held 0.700s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['9193fee4-5697-446a-8652-0cace350566e'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:41 devstack cinder-volume[86812]: WARNING cinder.db.api [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-903548089'] Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['f59432a2-10f9-4b60-ad34-5c0583e96ad5', '280d996f-c0c2-4ae0-b409-c9ec560b6ec6', 'ab5b9d03-2afa-48d4-81ad-e553c4d30cde', '85138ddc-3081-43ae-bbb0-b22413a579c3'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:41 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:32:41 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:42 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.264s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:42 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:32:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ca4dab64-4bf0-45b8-9c7c-a0b16afb12fe tempest-GroupSnapshotsTest-1216919171 None] Delete group completed successfully. Nov 01 12:32:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-60415209-503b-49d4-bdb4-2113af752f66 req-e50e007d-1c15-4547-ad7e-3f91181c7a95 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-60415209-503b-49d4-bdb4-2113af752f66 req-e50e007d-1c15-4547-ad7e-3f91181c7a95 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-60415209-503b-49d4-bdb4-2113af752f66 req-e50e007d-1c15-4547-ad7e-3f91181c7a95 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-60415209-503b-49d4-bdb4-2113af752f66 req-e50e007d-1c15-4547-ad7e-3f91181c7a95 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a4cccaa-f428-404e-a61c-715ec268f92e', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:32:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-60415209-503b-49d4-bdb4-2113af752f66 req-e50e007d-1c15-4547-ad7e-3f91181c7a95 tempest-TestServerVolumeAttachmentScenario-1866850028 None] attachment_update completed successfully. Nov 01 12:32:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b1c420e1-a936-4306-969b-d71332998aff tempest-GroupSnapshotsTest-1216919171 None] Group tempest-GroupSnapshotsTest-Group-1641491180: creating Nov 01 12:32:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b1c420e1-a936-4306-969b-d71332998aff tempest-GroupSnapshotsTest-1216919171 None] Group tempest-GroupSnapshotsTest-Group-1641491180: created successfully Nov 01 12:32:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b1c420e1-a936-4306-969b-d71332998aff tempest-GroupSnapshotsTest-1216919171 None] Create group completed successfully. Nov 01 12:32:43 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:32:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Flow 'volume_create_manager' (3fe32b6a-b2d7-449d-84d0-2e492cc815b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373304a7-6831-44dd-9f38-a976188d49fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373304a7-6831-44dd-9f38-a976188d49fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-104275413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=422262f5-1ee9-4527-9cb2-956124bcd6e0,host='devstack@QuobyteHD#QuobyteHD',id=317953b5-7ed6-4070-b039-926e99f9edda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a893c5adfa472aa7a8fe96ae1d29ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:44Z,use_quota=True,user_id='a7c5dc1c79224b7a8c83826c2e678f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec88bf1f-25e9-4762-99d1-b088fe3f5eb5),volume_type_id=ec88bf1f-25e9-4762-99d1-b088fe3f5eb5)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabf033b-c48b-4e95-a6c8-a81d47d3fb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabf033b-c48b-4e95-a6c8-a81d47d3fb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab47515f-2ec6-467a-a092-2d8700635d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab47515f-2ec6-467a-a092-2d8700635d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317953b5-7ed6-4070-b039-926e99f9edda', 'volume_name': 'volume-317953b5-7ed6-4070-b039-926e99f9edda', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb1f0c7-02fe-47e6-9998-5019fa12c250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb1f0c7-02fe-47e6-9998-5019fa12c250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138c02ac-89b5-4118-8126-89ef383a1c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Volume 317953b5-7ed6-4070-b039-926e99f9edda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317953b5-7ed6-4070-b039-926e99f9edda', 'volume_size': 1} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=422262f5-1ee9-4527-9cb2-956124bcd6e0,created_at=2026-11-01T11:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-104275413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=422262f5-1ee9-4527-9cb2-956124bcd6e0,host='devstack@QuobyteHD#QuobyteHD',id=317953b5-7ed6-4070-b039-926e99f9edda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a893c5adfa472aa7a8fe96ae1d29ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:44Z,use_quota=True,user_id='a7c5dc1c79224b7a8c83826c2e678f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec88bf1f-25e9-4762-99d1-b088fe3f5eb5),volume_type_id=ec88bf1f-25e9-4762-99d1-b088fe3f5eb5)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Creating volume 317953b5-7ed6-4070-b039-926e99f9edda {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:44 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:44 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda 1073741824 Nov 01 12:32:44 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:44 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda 1073741824" returned: 0 in 0.432s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:44 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda Nov 01 12:32:44 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:44 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (138c02ac-89b5-4118-8126-89ef383a1c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317953b5-7ed6-4070-b039-926e99f9edda', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cfe3b6-2794-406c-9308-77db301d7ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Volume volume-317953b5-7ed6-4070-b039-926e99f9edda (317953b5-7ed6-4070-b039-926e99f9edda): created successfully Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9cfe3b6-2794-406c-9308-77db301d7ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Flow 'volume_create_manager' (3fe32b6a-b2d7-449d-84d0-2e492cc815b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:44 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a1001472-3ed5-4ee8-8c07-f72987c8ec16 tempest-GroupSnapshotsTest-1216919171 None] Created volume successfully. Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Flow 'volume_create_manager' (56754c58-0ebb-43de-9b94-1863b055ba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa02f645-eb84-4fbf-b508-e9217684f461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa02f645-eb84-4fbf-b508-e9217684f461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1476481638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=422262f5-1ee9-4527-9cb2-956124bcd6e0,host='devstack@QuobyteHD#QuobyteHD',id=6e56853b-d75f-4ee4-a074-5804a3566233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a893c5adfa472aa7a8fe96ae1d29ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:46Z,use_quota=True,user_id='a7c5dc1c79224b7a8c83826c2e678f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec88bf1f-25e9-4762-99d1-b088fe3f5eb5),volume_type_id=ec88bf1f-25e9-4762-99d1-b088fe3f5eb5)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c667faa8-20bc-47a2-880c-686069ed37f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c667faa8-20bc-47a2-880c-686069ed37f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e747d9b7-2044-41e0-b8dc-c1b87555ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e747d9b7-2044-41e0-b8dc-c1b87555ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e56853b-d75f-4ee4-a074-5804a3566233', 'volume_name': 'volume-6e56853b-d75f-4ee4-a074-5804a3566233', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f011fc2d-a635-4ae4-b9a8-7ba8bc063fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f011fc2d-a635-4ae4-b9a8-7ba8bc063fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd378277-88dc-47bf-be1a-8cb510dfebeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:45 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Volume 6e56853b-d75f-4ee4-a074-5804a3566233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e56853b-d75f-4ee4-a074-5804a3566233', 'volume_size': 1} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=422262f5-1ee9-4527-9cb2-956124bcd6e0,created_at=2026-11-01T11:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1476481638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=422262f5-1ee9-4527-9cb2-956124bcd6e0,host='devstack@QuobyteHD#QuobyteHD',id=6e56853b-d75f-4ee4-a074-5804a3566233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a893c5adfa472aa7a8fe96ae1d29ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:46Z,use_quota=True,user_id='a7c5dc1c79224b7a8c83826c2e678f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec88bf1f-25e9-4762-99d1-b088fe3f5eb5),volume_type_id=ec88bf1f-25e9-4762-99d1-b088fe3f5eb5)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Creating volume 6e56853b-d75f-4ee4-a074-5804a3566233 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:45 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:32:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:45 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 1073741824 Nov 01 12:32:45 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:46 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 1073741824" returned: 0 in 0.467s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:46 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 Nov 01 12:32:46 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:46 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:32:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd378277-88dc-47bf-be1a-8cb510dfebeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e56853b-d75f-4ee4-a074-5804a3566233', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24e630b-f61a-4399-a38a-a6e8d6adc86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:46 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Volume volume-6e56853b-d75f-4ee4-a074-5804a3566233 (6e56853b-d75f-4ee4-a074-5804a3566233): created successfully Nov 01 12:32:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24e630b-f61a-4399-a38a-a6e8d6adc86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Flow 'volume_create_manager' (56754c58-0ebb-43de-9b94-1863b055ba5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-02602dd5-a00e-462f-97fa-cd4a83c5542c tempest-GroupSnapshotsTest-1216919171 None] Created volume successfully. Nov 01 12:32:47 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-2384294d-9f6d-4a1a-9db2-1ffdd6015d8e tempest-GroupSnapshotsTest-1216919171 None] Update group completed successfully. Nov 01 12:32:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-1edd1adc-c5b3-4a57-b514-88aee41e7203 req-eb74e8f4-60f2-4ff1-9c1d-e081286f58c6 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-1edd1adc-c5b3-4a57-b514-88aee41e7203 req-eb74e8f4-60f2-4ff1-9c1d-e081286f58c6 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-1edd1adc-c5b3-4a57-b514-88aee41e7203 req-eb74e8f4-60f2-4ff1-9c1d-e081286f58c6 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-1edd1adc-c5b3-4a57-b514-88aee41e7203 req-eb74e8f4-60f2-4ff1-9c1d-e081286f58c6 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73c0470e-08fc-428f-be94-8a0079d4b76c', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:32:47 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-1edd1adc-c5b3-4a57-b514-88aee41e7203 req-eb74e8f4-60f2-4ff1-9c1d-e081286f58c6 tempest-TestServerVolumeAttachmentScenario-1866850028 None] attachment_update completed successfully. Nov 01 12:32:48 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=97,cinder:UPDATE=80,cinder:DELETE=6,cinder:INSERT=16 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:32:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8654b0c1-1dbc-4087-bfb6-0d4483f244e4 tempest-GroupSnapshotsTest-1216919171 None] Update group completed successfully. Nov 01 12:32:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-53bb8d48-01de-45e5-8a1e-102264614738 req-b217ade9-f0ba-40ab-b0b8-41d752f0b1d0 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Terminate volume connection completed successfully. Nov 01 12:32:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-53bb8d48-01de-45e5-8a1e-102264614738 req-b217ade9-f0ba-40ab-b0b8-41d752f0b1d0 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Deleting attachment 73c0470e-08fc-428f-be94-8a0079d4b76c. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:32:49 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8c7a34c4-7f23-4631-b6c8-5698df4540fa tempest-GroupSnapshotsTest-1216919171 None] Update group completed successfully. Nov 01 12:32:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-eef9a783-3164-4c5e-bab6-2835123edb32 req-af3a714b-8ee5-46e4-a941-c382689a81d7 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Terminate volume connection completed successfully. Nov 01 12:32:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-eef9a783-3164-4c5e-bab6-2835123edb32 req-af3a714b-8ee5-46e4-a941-c382689a81d7 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Deleting attachment 5a4cccaa-f428-404e-a61c-715ec268f92e. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:32:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-13cb810f-4785-473f-a49c-28ac4cb0ec92 tempest-GroupSnapshotsTest-1216919171 None] Update group completed successfully. Nov 01 12:32:52 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] GroupSnapshot bd299802-4445-42f4-ae74-84fe6c5bb936: creating. Nov 01 12:32:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Group snapshot bd299802-4445-42f4-ae74-84fe6c5bb936: creating. {{(pid=86812) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 12:32:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Creating offline snapshot 2a006472-0e13-4b31-8d83-1198d3c044fd of volume 317953b5-7ed6-4070-b039-926e99f9edda {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:32:52 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9803873c-6bf2-4b1a-93df-d19960f94d1c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:52 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda Nov 01 12:32:52 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:53 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda" returned: 0 in 0.447s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:53 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd 1G Nov 01 12:32:53 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:53 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd 1G" returned: 0 in 0.452s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-317953b5-7ed6-4070-b039-926e99f9edda -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:53 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-317953b5-7ed6-4070-b039-926e99f9edda -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd Nov 01 12:32:53 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:53 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-317953b5-7ed6-4070-b039-926e99f9edda -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd" returned: 0 in 0.297s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:53 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:32:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:53 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd Nov 01 12:32:53 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:54 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:54 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.info Nov 01 12:32:54 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:54 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.info" returned: 0 in 0.291s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:54 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:54 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.info Nov 01 12:32:54 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:54 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.info" returned: 0 in 0.238s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Creating offline snapshot 6945239c-c757-4291-ba5f-7ac00eecbcc2 of volume 6e56853b-d75f-4ee4-a074-5804a3566233 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9956853-800a-4b55-9ecb-ee71f4f00c86]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:54 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 Nov 01 12:32:54 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "cinder-a070e7d0-ab26-4a73-ba56-ae5300b019f3-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "cinder-a070e7d0-ab26-4a73-ba56-ae5300b019f3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:55 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "cinder-quobyte-a070e7d0-ab26-4a73-ba56-ae5300b019f3" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233" returned: 0 in 0.375s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "cinder-quobyte-a070e7d0-ab26-4a73-ba56-ae5300b019f3" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:55 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 1G Nov 01 12:32:55 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe471ef-9ded-4c5b-8ddf-87d2f5adde46]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:55 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3 Nov 01 12:32:55 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:55 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 1G" returned: 0 in 0.416s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e56853b-d75f-4ee4-a074-5804a3566233 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:55 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3" returned: 0 in 0.387s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:55 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e56853b-d75f-4ee4-a074-5804a3566233 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 Nov 01 12:32:55 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:55 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3 Nov 01 12:32:55 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:55 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a070e7d0-ab26-4a73-ba56-ae5300b019f3" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "cinder-quobyte-a070e7d0-ab26-4a73-ba56-ae5300b019f3" released by "delete_volume" :: held 0.689s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:55 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e56853b-d75f-4ee4-a074-5804a3566233 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2" returned: 0 in 0.305s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:55 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:55 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 Nov 01 12:32:55 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Created reservations ['560872cd-2ead-4f38-b039-40702e411c1c', '6e1005c8-61b2-40b5-b198-321f35fb492f', 'af38bb31-f063-4209-8695-9942fcaca8d2', '5a05d286-2bb0-4aab-895a-00b79109d4c2'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:55 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:32:55 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:56 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2" returned: 0 in 0.268s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:56 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.info Nov 01 12:32:56 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:56 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.278s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "cinder-37ed90a9-657e-4b6a-8c3d-16f2049cd554-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Deleted volume successfully. Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "cinder-37ed90a9-657e-4b6a-8c3d-16f2049cd554-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ef47411b-42a2-470b-96f7-a506aabce6fe tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "cinder-a070e7d0-ab26-4a73-ba56-ae5300b019f3-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "cinder-quobyte-37ed90a9-657e-4b6a-8c3d-16f2049cd554" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "cinder-quobyte-37ed90a9-657e-4b6a-8c3d-16f2049cd554" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4629ca6-be90-44f9-af94-71c7b24add49]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:56 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.info" returned: 0 in 0.285s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:56 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:56 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554 Nov 01 12:32:56 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:56 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.info Nov 01 12:32:56 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:56 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:56 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554" returned: 0 in 0.369s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.info" returned: 0 in 0.281s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:56 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554 Nov 01 12:32:56 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7bbcd3bf-8372-4b5d-b030-38ae1b5f6d89 tempest-GroupSnapshotsTest-1216919171 None] group_snapshot bd299802-4445-42f4-ae74-84fe6c5bb936: created successfully Nov 01 12:32:56 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-37ed90a9-657e-4b6a-8c3d-16f2049cd554" returned: 0 in 0.266s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "cinder-quobyte-37ed90a9-657e-4b6a-8c3d-16f2049cd554" released by "delete_volume" :: held 0.680s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:56 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Created reservations ['41b1cd42-1830-4e42-9fc1-3226316df702', '7a8b4109-5c66-4777-927b-860be8c77fdf', 'cc9ca6f1-23a8-4a58-8c9d-5fde5e321e37', 'b8ed5ca7-ffc7-4425-a04b-d76360e97e19'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:57 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:32:57 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:57 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:32:57 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Deleted volume successfully. Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a97fcc31-1551-4ac3-84ad-df7d308b86a2 tempest-TestServerVolumeAttachmentScenario-1866850028 None] Lock "cinder-37ed90a9-657e-4b6a-8c3d-16f2049cd554-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:57 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] group_snapshot bd299802-4445-42f4-ae74-84fe6c5bb936: deleting Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] group_snapshot bd299802-4445-42f4-ae74-84fe6c5bb936: deleting {{(pid=86812) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-317953b5-7ed6-4070-b039-926e99f9edda" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-317953b5-7ed6-4070-b039-926e99f9edda" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-2a006472-0e13-4b31-8d83-1198d3c044fd" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-2a006472-0e13-4b31-8d83-1198d3c044fd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Deleting offline snapshot 2a006472-0e13-4b31-8d83-1198d3c044fd of volume 317953b5-7ed6-4070-b039-926e99f9edda {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:32:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] snapshot_file for this snap is: volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:32:58 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec6d797-c62f-44ad-95c8-55d569c490f9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:58 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd Nov 01 12:32:58 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:58 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd" returned: 0 in 0.415s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-317953b5-7ed6-4070-b039-926e99f9edda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:32:58 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae6b76-161c-4994-8754-f01767aa9429]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:58 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda Nov 01 12:32:58 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:58 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda" returned: 0 in 0.408s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:58 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd Nov 01 12:32:58 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:59 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd" returned: 0 in 0.360s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:59 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd Nov 01 12:32:59 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:59 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda.2a006472-0e13-4b31-8d83-1198d3c044fd" returned: 0 in 0.248s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-2a006472-0e13-4b31-8d83-1198d3c044fd" released by "_delete_snapshot" :: held 1.567s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-317953b5-7ed6-4070-b039-926e99f9edda" released by "delete_snapshot" :: held 1.597s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-6e56853b-d75f-4ee4-a074-5804a3566233" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-6e56853b-d75f-4ee4-a074-5804a3566233" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-6945239c-c757-4291-ba5f-7ac00eecbcc2" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-6945239c-c757-4291-ba5f-7ac00eecbcc2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Deleting offline snapshot 6945239c-c757-4291-ba5f-7ac00eecbcc2 of volume 6e56853b-d75f-4ee4-a074-5804a3566233 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] snapshot_file for this snap is: volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ab2628-0bf2-49ab-a8a7-efd5bf4a697e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:59 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 Nov 01 12:32:59 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:00 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2" returned: 0 in 0.387s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e56853b-d75f-4ee4-a074-5804a3566233(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:00 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf04c6cf-4a98-4105-937d-de78711374e8]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:00 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 Nov 01 12:33:00 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:00 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233" returned: 0 in 0.367s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:00 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 Nov 01 12:33:00 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:00 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2" returned: 0 in 0.425s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:00 devstack sudo[101690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2 Nov 01 12:33:00 devstack sudo[101690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:01 devstack sudo[101690]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233.6945239c-c757-4291-ba5f-7ac00eecbcc2" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-6945239c-c757-4291-ba5f-7ac00eecbcc2" released by "_delete_snapshot" :: held 1.545s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-6e56853b-d75f-4ee4-a074-5804a3566233" released by "delete_snapshot" :: held 1.574s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:01 devstack cinder-volume[86812]: WARNING cinder.quota [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1604224256 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1604224256, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:33:01 devstack cinder-volume[86812]: WARNING cinder.quota [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1604224256 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1604224256, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:33:01 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['58574777-b27d-4f0b-b9ce-b2031eb86419', 'e5dd72ab-57ca-4813-8e16-b58afd5e5908', 'b77aa059-4d81-4aec-b16f-5fbe38da1cd3', '1e117fb3-c3c0-4990-a560-91eb8a21b61d'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:01 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['31857e27-86de-4312-a830-0081334ca667', '2c49a522-c707-45e2-9bd9-e1e0bd1a3cc5', '2550b48d-d3de-4293-a006-65be42316e09', '60c675bf-6e9b-4a44-a6c1-03486a01f0dd'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:01 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7fbf6a3f-c2aa-48a7-b52b-8b4b1a0ddbca tempest-GroupSnapshotsTest-1216919171 None] group_snapshot bd299802-4445-42f4-ae74-84fe6c5bb936: deleted successfully Nov 01 12:33:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-317953b5-7ed6-4070-b039-926e99f9edda" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-317953b5-7ed6-4070-b039-926e99f9edda" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:02 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff2ba44-74da-461d-9679-254f23a50080]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:03 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda Nov 01 12:33:03 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:03 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda" returned: 0 in 0.427s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:03 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda Nov 01 12:33:03 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:03 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-317953b5-7ed6-4070-b039-926e99f9edda" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-317953b5-7ed6-4070-b039-926e99f9edda" released by "delete_volume" :: held 0.782s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-6e56853b-d75f-4ee4-a074-5804a3566233" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-6e56853b-d75f-4ee4-a074-5804a3566233" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:03 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abda11a-85db-4ab2-941b-ff54fc41e17d]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:03 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 Nov 01 12:33:03 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:04 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233" returned: 0 in 0.424s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:04 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233 Nov 01 12:33:04 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:04 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6e56853b-d75f-4ee4-a074-5804a3566233" returned: 0 in 0.245s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-6e56853b-d75f-4ee4-a074-5804a3566233" released by "delete_volume" :: held 0.738s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['dd5e5ad4-cc81-4aa5-ae5d-86e7838566fa'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:04 devstack cinder-volume[86812]: WARNING cinder.quota [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1604224256 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1604224256, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['a88e3b66-577f-4ae8-9341-355b76a690f0', '37fbd52a-3b94-4949-b646-528c897799d4', 'e0a55e6d-a22f-401b-9cd1-fa3d499f0091', '949bb660-b75d-4584-81ec-5a973968ead7'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['c1e5ffbd-2db2-4cc6-bcc1-f7aefce601c8', '1b083027-7ac6-4145-a4a3-75d72df06f9f', '46b71d09-faf8-4a68-922d-42f8da47152a', '77aac7ac-c0e7-4a82-a511-8c7700d01e94'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:04 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:33:04 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:04 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:04 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:04 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-705a696f-5188-400d-a5b9-6a0c727f22fd tempest-GroupSnapshotsTest-1216919171 None] Delete group completed successfully. Nov 01 12:33:05 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-be77523e-14e1-4f44-8f72-0c44ad0da449 tempest-GroupSnapshotsTest-1216919171 None] Group tempest-GroupSnapshotsTest-Group-407288360: creating Nov 01 12:33:05 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-be77523e-14e1-4f44-8f72-0c44ad0da449 tempest-GroupSnapshotsTest-1216919171 None] Group tempest-GroupSnapshotsTest-Group-407288360: created successfully Nov 01 12:33:05 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-be77523e-14e1-4f44-8f72-0c44ad0da449 tempest-GroupSnapshotsTest-1216919171 None] Create group completed successfully. Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Flow 'volume_create_manager' (5ba4ac15-53c3-4321-8cfe-96b35608171c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce59a0f9-f3ac-4b84-aa48-e289312c8b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce59a0f9-f3ac-4b84-aa48-e289312c8b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1173548524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e457eb08-047f-4eea-944f-89344b5d7276,host='devstack@QuobyteHD#QuobyteHD',id=13ab992b-95b8-4807-bdf1-73a6a9640d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a893c5adfa472aa7a8fe96ae1d29ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:07Z,use_quota=True,user_id='a7c5dc1c79224b7a8c83826c2e678f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c2773d-c8f1-4d36-946d-bb187c91df54),volume_type_id=57c2773d-c8f1-4d36-946d-bb187c91df54)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2920166f-6cdd-4fb4-95c0-7e497a0420d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2920166f-6cdd-4fb4-95c0-7e497a0420d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b049916e-578f-4530-b385-ea3a6c6db4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b049916e-578f-4530-b385-ea3a6c6db4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13ab992b-95b8-4807-bdf1-73a6a9640d0f', 'volume_name': 'volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c9bc82-1033-4b33-90e1-70e18251241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c9bc82-1033-4b33-90e1-70e18251241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc0e513-a595-45cb-acdd-afd315ba51d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:07 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Volume 13ab992b-95b8-4807-bdf1-73a6a9640d0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f', 'volume_size': 1} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e457eb08-047f-4eea-944f-89344b5d7276,created_at=2026-11-01T11:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1173548524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e457eb08-047f-4eea-944f-89344b5d7276,host='devstack@QuobyteHD#QuobyteHD',id=13ab992b-95b8-4807-bdf1-73a6a9640d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a893c5adfa472aa7a8fe96ae1d29ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:07Z,use_quota=True,user_id='a7c5dc1c79224b7a8c83826c2e678f17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57c2773d-c8f1-4d36-946d-bb187c91df54),volume_type_id=57c2773d-c8f1-4d36-946d-bb187c91df54)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Creating volume 13ab992b-95b8-4807-bdf1-73a6a9640d0f {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:07 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:07 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f 1073741824 Nov 01 12:33:07 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:07 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f 1073741824" returned: 0 in 0.426s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:07 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f Nov 01 12:33:07 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:08 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc0e513-a595-45cb-acdd-afd315ba51d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4bc1ec-4204-432d-a1ba-60e057000dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:08 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Volume volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f (13ab992b-95b8-4807-bdf1-73a6a9640d0f): created successfully Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4bc1ec-4204-432d-a1ba-60e057000dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Flow 'volume_create_manager' (5ba4ac15-53c3-4321-8cfe-96b35608171c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:08 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c13dceb5-3d67-4556-892b-cbfb0fe5913a tempest-GroupSnapshotsTest-1216919171 None] Created volume successfully. Nov 01 12:33:08 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] GroupSnapshot c684609d-efde-46ef-aecc-799b16b4e960: creating. Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Group snapshot c684609d-efde-46ef-aecc-799b16b4e960: creating. {{(pid=86812) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Creating offline snapshot a7a202af-14ea-4259-a713-d724b46560f6 of volume 13ab992b-95b8-4807-bdf1-73a6a9640d0f {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d60a2-412c-4eaf-81f2-cc76fdf952da]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:08 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f Nov 01 12:33:08 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:09 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f" returned: 0 in 0.406s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:09 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 1G Nov 01 12:33:09 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:09 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 1G" returned: 0 in 0.457s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:09 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 Nov 01 12:33:09 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:09 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6" returned: 0 in 0.328s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:09 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:33:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:10 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 Nov 01 12:33:10 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:10 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6" returned: 0 in 0.267s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:10 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.info Nov 01 12:33:10 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:10 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.info" returned: 0 in 0.279s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:10 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:33:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:10 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.info Nov 01 12:33:10 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:10 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.info" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:10 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-78150cb7-74ef-4f8f-93cf-90d4e637c7d0 tempest-GroupSnapshotsTest-1216919171 None] group_snapshot c684609d-efde-46ef-aecc-799b16b4e960: created successfully Nov 01 12:33:12 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] group_snapshot c684609d-efde-46ef-aecc-799b16b4e960: deleting Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] group_snapshot c684609d-efde-46ef-aecc-799b16b4e960: deleting {{(pid=86812) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-13ab992b-95b8-4807-bdf1-73a6a9640d0f" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-13ab992b-95b8-4807-bdf1-73a6a9640d0f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-a7a202af-14ea-4259-a713-d724b46560f6" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-a7a202af-14ea-4259-a713-d724b46560f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Deleting offline snapshot a7a202af-14ea-4259-a713-d724b46560f6 of volume 13ab992b-95b8-4807-bdf1-73a6a9640d0f {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] snapshot_file for this snap is: volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[084b1f07-3199-4343-8081-c560a2ed6cf4]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:12 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 Nov 01 12:33:12 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:12 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6" returned: 0 in 0.527s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fbf322-2a1d-4a7a-a081-9df535d4b751]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:12 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f Nov 01 12:33:12 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:13 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f" returned: 0 in 0.368s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:13 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 Nov 01 12:33:13 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:13 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6" returned: 0 in 0.358s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:13 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6 Nov 01 12:33:13 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:13 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f.a7a202af-14ea-4259-a713-d724b46560f6" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-a7a202af-14ea-4259-a713-d724b46560f6" released by "_delete_snapshot" :: held 1.623s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-13ab992b-95b8-4807-bdf1-73a6a9640d0f" released by "delete_snapshot" :: held 1.648s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:13 devstack cinder-volume[86812]: WARNING cinder.quota [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-242701027 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-242701027, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:33:13 devstack cinder-volume[86812]: WARNING cinder.quota [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-242701027 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-242701027, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:33:13 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['00c06378-562c-4ecd-9e42-fb0af4b4eb26', 'f5b98055-2616-4a26-a6f1-a6c336495760', '548b3b8e-29e2-415e-b7f5-aaaf2f9ee0f0', '67134d97-168a-4a74-9f57-9ce9e682fdc4'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:13 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-fa1c8ab1-dfcf-4b57-9d79-6b9ded4d4fdd tempest-GroupSnapshotsTest-1216919171 None] group_snapshot c684609d-efde-46ef-aecc-799b16b4e960: deleted successfully Nov 01 12:33:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "cinder-quobyte-13ab992b-95b8-4807-bdf1-73a6a9640d0f" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-13ab992b-95b8-4807-bdf1-73a6a9640d0f" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:14 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe69796c-3b94-48be-a726-290c8137351b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:14 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f Nov 01 12:33:14 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:15 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f" returned: 0 in 0.380s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:15 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f Nov 01 12:33:15 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:15 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-13ab992b-95b8-4807-bdf1-73a6a9640d0f" returned: 0 in 0.262s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Lock "cinder-quobyte-13ab992b-95b8-4807-bdf1-73a6a9640d0f" released by "delete_volume" :: held 0.723s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['d81d178a-0104-4fc1-91bd-ee15840da6df'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:15 devstack cinder-volume[86812]: WARNING cinder.quota [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-242701027 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-242701027, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Created reservations ['ca0dbfc3-e619-407b-9b14-d6a61053712b', '96133c80-4944-40d1-a844-e5f77251fd1f', '7e0e10b9-a627-4687-92f1-fbf6899df258', '3b417e3a-84a8-4a0d-93a5-833c391ed0f0'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:15 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:33:15 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:15 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.268s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:15 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:15 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1101d4c8-ef41-474a-9cbd-78cb76379745 tempest-GroupSnapshotsTest-1216919171 None] Delete group completed successfully. Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Flow 'volume_create_manager' (362e0477-df81-4b6e-a8e5-be1d1a4b8033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167b2d0b-19d5-4f6e-93e2-9554984f7345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (167b2d0b-19d5-4f6e-93e2-9554984f7345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1363246007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e5519b-6df7-4f52-95f4-f5d53adfb3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c82f13b0b64cb0b9081508acfd3470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:22Z,use_quota=True,user_id='10440bcf930f4eb6a136faea3ce3a08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e60e09e-8438-4341-95ab-1841f08d52d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e60e09e-8438-4341-95ab-1841f08d52d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44aa807-d975-4915-a7de-914f1e35458e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44aa807-d975-4915-a7de-914f1e35458e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e5519b-6df7-4f52-95f4-f5d53adfb3f6', 'volume_name': 'volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8118828b-0c2e-4563-892a-38ef8467315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8118828b-0c2e-4563-892a-38ef8467315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91de624d-fee7-4923-989a-dbcd643df361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:21 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6', 'volume_size': 1} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1363246007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e5519b-6df7-4f52-95f4-f5d53adfb3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6c82f13b0b64cb0b9081508acfd3470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:22Z,use_quota=True,user_id='10440bcf930f4eb6a136faea3ce3a08b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Creating volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:21 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:33:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:21 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 1073741824 Nov 01 12:33:21 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:22 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 1073741824" returned: 0 in 0.436s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:22 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 Nov 01 12:33:22 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:22 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" returned: 0 in 0.244s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91de624d-fee7-4923-989a-dbcd643df361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cec8e8-fdf4-4c1c-bbb7-24857779c021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:22 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Volume volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 (50e5519b-6df7-4f52-95f4-f5d53adfb3f6): created successfully Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cec8e8-fdf4-4c1c-bbb7-24857779c021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Flow 'volume_create_manager' (362e0477-df81-4b6e-a8e5-be1d1a4b8033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0cd91da9-e64b-4881-835c-f3f8ab5fe15d tempest-SnapshotsActionsTest-1508498398 None] Created volume successfully. Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=132,cinder:SELECT=132,cinder:DELETE=5,cinder:INSERT=27 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:33:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Creating offline snapshot db6d7fd5-6233-4622-af46-f18f3eca1fbd of volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:23 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aadd438-b34e-4d2e-b273-6f31e0cb3f3c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:23 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 Nov 01 12:33:23 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:23 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" returned: 0 in 0.368s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:23 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd 1G Nov 01 12:33:23 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:23 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd 1G" returned: 0 in 0.392s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:23 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:23 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:24 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.423s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:24 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd is being set with open permissions: ugo+rw Nov 01 12:33:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:24 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:24 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:24 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.247s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:24 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.info Nov 01 12:33:24 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:24 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.info" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:24 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.info is being set with open permissions: ugo+rw Nov 01 12:33:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:24 devstack sudo[101861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.info Nov 01 12:33:24 devstack sudo[101861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:25 devstack sudo[101861]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.info" returned: 0 in 0.272s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e6e4ab9e-82ff-46b0-91ed-aebc2c6b9695 tempest-SnapshotsActionsTest-1508498398 None] Create snapshot completed successfully Nov 01 12:33:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] Creating offline snapshot 93adcc11-ef39-4a28-9e7d-8eabd3995392 of volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:26 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf613da-69a2-4f16-a98f-453f0c22a14f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:26 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:26 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:27 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.425s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:27 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 1G Nov 01 12:33:27 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:27 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 1G" returned: 0 in 0.615s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:27 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 Nov 01 12:33:27 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:28 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392" returned: 0 in 0.371s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:28 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 is being set with open permissions: ugo+rw Nov 01 12:33:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:28 devstack sudo[101880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 Nov 01 12:33:28 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:28 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1058933f-3cfb-4370-aef4-2b98e69b6522 tempest-SnapshotsActionsTest-1508498398 None] Create snapshot completed successfully Nov 01 12:33:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-93adcc11-ef39-4a28-9e7d-8eabd3995392-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-93adcc11-ef39-4a28-9e7d-8eabd3995392-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-quobyte-93adcc11-ef39-4a28-9e7d-8eabd3995392" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-93adcc11-ef39-4a28-9e7d-8eabd3995392" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Deleting offline snapshot 93adcc11-ef39-4a28-9e7d-8eabd3995392 of volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] snapshot_file for this snap is: volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52b7abb-c36a-43a5-b268-1811f1484762]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:29 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 Nov 01 12:33:29 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:29 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392" returned: 0 in 0.399s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4588a6-6591-4911-939c-6217f2e351c1]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:29 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:29 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:29 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.397s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:29 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 Nov 01 12:33:29 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:30 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392" returned: 0 in 0.391s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:30 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392 Nov 01 12:33:30 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:30 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.93adcc11-ef39-4a28-9e7d-8eabd3995392" returned: 0 in 0.282s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-93adcc11-ef39-4a28-9e7d-8eabd3995392" released by "_delete_snapshot" :: held 1.592s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" released by "delete_snapshot" :: held 1.618s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:30 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Created reservations ['c4a95ce1-7bc7-420b-9170-8708fd8a37df', '547ea7a7-4d62-4596-a6ae-895e8df9b163', '259610d9-b0a0-4dfb-b234-195a7fbf7620', 'fa15866c-036b-4029-bc09-6cacc3626b2a'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:30 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Delete snapshot completed successfully. Nov 01 12:33:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-10b4938a-7ee1-4b31-bc45-eb7cead95b67 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-93adcc11-ef39-4a28-9e7d-8eabd3995392-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Flow 'volume_create_manager' (6c084faf-a555-43f8-8085-23c52b11cf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acad53a-036f-4502-96d8-937a5fbdfb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acad53a-036f-4502-96d8-937a5fbdfb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-678877523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b593feb3-742d-4ced-8f67-f3e0e4617660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9231260c0e3245f393de563becc221fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:31Z,use_quota=True,user_id='2b3b7b8a76f44c45aa15ce8029a8308b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552d28aa-c037-4835-9c49-08a3c1b1d3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (552d28aa-c037-4835-9c49-08a3c1b1d3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59586a86-a09d-48f8-b0c4-9d5aa114a43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.image.glance [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Creating Keystone auth plugin from conf {{(pid=86812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] Creating offline snapshot 34fedad9-cc89-4f94-aa97-ec314915b255 of volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0368d39-bcbc-451a-9734-feaa125ba710]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:31 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:31 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59586a86-a09d-48f8-b0c4-9d5aa114a43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b593feb3-742d-4ced-8f67-f3e0e4617660', 'volume_name': 'volume-b593feb3-742d-4ced-8f67-f3e0e4617660', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fc0f72-c9fb-4c90-9a4a-98e84db82905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fc0f72-c9fb-4c90-9a4a-98e84db82905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fef132d-0681-4f2c-ab89-6b7fbec6d474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:31 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Volume b593feb3-742d-4ced-8f67-f3e0e4617660: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b593feb3-742d-4ced-8f67-f3e0e4617660', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Trying to clone b593feb3-742d-4ced-8f67-f3e0e4617660 from image c5fdc172-8826-4b34-a68d-2114e120626b at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]). {{(pid=86812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:33:31 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.378s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:31 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 1G Nov 01 12:33:31 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:33:32 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Image download 20.69 MB at 20.69 MB/s Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4417c3-e48d-401a-9f91-57348f453035]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:32 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD Nov 01 12:33:32 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:32 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 1G" returned: 0 in 0.454s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:32 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 Nov 01 12:33:32 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:32 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Temporary image c5fdc172-8826-4b34-a68d-2114e120626b is fetched for user 2b3b7b8a76f44c45aa15ce8029a8308b. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1217bcda-37d6-4b34-89a0-55aaf88245d9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:32 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255" returned: 0 in 0.284s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:32 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 is being set with open permissions: ugo+rw Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:32 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD Nov 01 12:33:32 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:32 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 Nov 01 12:33:32 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:32 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:32 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255" returned: 0 in 0.233s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.454s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-678877523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b593feb3-742d-4ced-8f67-f3e0e4617660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9231260c0e3245f393de563becc221fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:31Z,use_quota=True,user_id='2b3b7b8a76f44c45aa15ce8029a8308b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Creating volume b593feb3-742d-4ced-8f67-f3e0e4617660 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:32 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:33:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:32 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 1073741824 Nov 01 12:33:32 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:32 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-87e208ce-a41f-4afe-b377-0f79e3648f35 tempest-SnapshotsActionsTest-1508498398 None] Create snapshot completed successfully Nov 01 12:33:33 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 1073741824" returned: 0 in 0.403s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:33 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 Nov 01 12:33:33 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:33 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Attempting download of c5fdc172-8826-4b34-a68d-2114e120626b ((None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}])) to volume b593feb3-742d-4ced-8f67-f3e0e4617660. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-34fedad9-cc89-4f94-aa97-ec314915b255-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-34fedad9-cc89-4f94-aa97-ec314915b255-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-quobyte-34fedad9-cc89-4f94-aa97-ec314915b255" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11cdfbc-c688-469a-8609-5304d361feae]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_fdx2aoe5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-34fedad9-cc89-4f94-aa97-ec314915b255" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Deleting offline snapshot 34fedad9-cc89-4f94-aa97-ec314915b255 of volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] snapshot_file for this snap is: volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eedbbd2-ddfc-4654-8d6a-d3f9e0c12d49]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:33 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_fdx2aoe5 Nov 01 12:33:33 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:33 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 Nov 01 12:33:33 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:33 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_fdx2aoe5" returned: 0 in 0.334s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_fdx2aoe5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:34 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255" returned: 0 in 0.369s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:34 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_fdx2aoe5 Nov 01 12:33:34 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fa4f4b-55ed-418a-b032-f42a43512587]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:34 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:34 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:34 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_fdx2aoe5" returned: 1 in 0.342s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_fdx2aoe5' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce115d5-788b-498f-a452-b2e1e6cccd43]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:34 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD Nov 01 12:33:34 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:34 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.382s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:34 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 Nov 01 12:33:34 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:34 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] c5fdc172-8826-4b34-a68d-2114e120626b was qcow2, converting to qcow2 {{(pid=86812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:34 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 Nov 01 12:33:34 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:34 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255" returned: 0 in 0.353s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:34 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255 Nov 01 12:33:34 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:35 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.34fedad9-cc89-4f94-aa97-ec314915b255" returned: 0 in 0.267s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-34fedad9-cc89-4f94-aa97-ec314915b255" released by "_delete_snapshot" :: held 1.482s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" released by "delete_snapshot" :: held 1.514s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:35 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Created reservations ['bfc8e0e6-aa76-4bb9-9352-22947b220230', '7cb163fc-897c-467e-9474-de6fc90285c5', '20f7a3ed-3add-49f1-a4ae-40a64ba06840', 'c3b1082e-88b5-4b38-b163-5a698c1207cb'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Delete snapshot completed successfully. Nov 01 12:33:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-16482863-6ef4-4980-acbc-7d3b403ee0e3 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-34fedad9-cc89-4f94-aa97-ec314915b255-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] Creating offline snapshot c0b091a4-9c59-45c2-8d93-febd6ae771b9 of volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadeef11-5ba8-4961-b4a7-1d37dc5e48ea]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:36 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:36 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:36 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660" returned: 0 in 1.853s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_2w1eaz2xdevstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:33:36 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Converted 112.00 MB image at 60.42 MB/s Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:36 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.402s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:36 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 1G Nov 01 12:33:36 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:36 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 1G Nov 01 12:33:36 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:36 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 1G" returned: 0 in 0.319s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Downloaded image c5fdc172-8826-4b34-a68d-2114e120626b ((None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}])) to volume b593feb3-742d-4ced-8f67-f3e0e4617660 successfully. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Temporary image c5fdc172-8826-4b34-a68d-2114e120626b for user 2b3b7b8a76f44c45aa15ce8029a8308b is deleted. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Marking volume b593feb3-742d-4ced-8f67-f3e0e4617660 as bootable. {{(pid=86812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Copying metadata from image c5fdc172-8826-4b34-a68d-2114e120626b to b593feb3-742d-4ced-8f67-f3e0e4617660. {{(pid=86812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Creating volume glance metadata for volume b593feb3-742d-4ced-8f67-f3e0e4617660 backed by image c5fdc172-8826-4b34-a68d-2114e120626b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fef132d-0681-4f2c-ab89-6b7fbec6d474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b593feb3-742d-4ced-8f67-f3e0e4617660', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27253cb5-6d36-4edc-90f7-d1ce2158ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:37 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Volume volume-b593feb3-742d-4ced-8f67-f3e0e4617660 (b593feb3-742d-4ced-8f67-f3e0e4617660): created successfully Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27253cb5-6d36-4edc-90f7-d1ce2158ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:37 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:33:37 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Flow 'volume_create_manager' (6c084faf-a555-43f8-8085-23c52b11cf5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:37 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 1G" returned: 0 in 0.474s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:37 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-445dc835-651e-4f46-bbfa-ca0ee1fc6310 tempest-TestShelveInstance-530934980 None] Created volume successfully. Nov 01 12:33:37 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 Nov 01 12:33:37 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:37 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:33:37 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9" returned: 0 in 0.294s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:37 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 is being set with open permissions: ugo+rw Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:37 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 Nov 01 12:33:37 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:37 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9" returned: 0 in 0.244s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.527s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:37 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-15706268-0518-4a4f-89c0-076d1ee70ba6 tempest-SnapshotsActionsTest-1508498398 None] Create snapshot completed successfully Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-c0b091a4-9c59-45c2-8d93-febd6ae771b9-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-c0b091a4-9c59-45c2-8d93-febd6ae771b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-quobyte-c0b091a4-9c59-45c2-8d93-febd6ae771b9" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-c0b091a4-9c59-45c2-8d93-febd6ae771b9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Deleting offline snapshot c0b091a4-9c59-45c2-8d93-febd6ae771b9 of volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] snapshot_file for this snap is: volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[910ace83-2375-44cc-9ce0-5c1a8082d680]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:38 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 Nov 01 12:33:38 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:38 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9" returned: 0 in 0.391s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[721910ab-7664-41ab-85a8-15d3c8628a09]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:38 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:38 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:39 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.395s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:39 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 Nov 01 12:33:39 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:39 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9" returned: 0 in 0.458s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:39 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9 Nov 01 12:33:39 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:39 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.c0b091a4-9c59-45c2-8d93-febd6ae771b9" returned: 0 in 0.289s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-c0b091a4-9c59-45c2-8d93-febd6ae771b9" released by "_delete_snapshot" :: held 1.667s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" released by "delete_snapshot" :: held 1.696s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-e6a04530-f7ef-4507-b745-b2c95a3b4373 req-8098092e-78f5-475b-bbc1-97e88f6de09e tempest-TestShelveInstance-530934980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-e6a04530-f7ef-4507-b745-b2c95a3b4373 req-8098092e-78f5-475b-bbc1-97e88f6de09e tempest-TestShelveInstance-530934980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-e6a04530-f7ef-4507-b745-b2c95a3b4373 req-8098092e-78f5-475b-bbc1-97e88f6de09e tempest-TestShelveInstance-530934980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Created reservations ['de4979e1-fc27-4b3e-9100-df2b4169ab06', 'd76044b2-db95-46e0-b689-9f4ed71fbf6e', '01c4b049-c1d3-456e-a2e3-95df0b158b4d', 'a9ea4ce8-bf66-4ae1-9737-e663a84d39de'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-e6a04530-f7ef-4507-b745-b2c95a3b4373 req-8098092e-78f5-475b-bbc1-97e88f6de09e tempest-TestShelveInstance-530934980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-b593feb3-742d-4ced-8f67-f3e0e4617660', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '122f83be-dbad-463b-9516-a690e42a284a', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:33:40 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-e6a04530-f7ef-4507-b745-b2c95a3b4373 req-8098092e-78f5-475b-bbc1-97e88f6de09e tempest-TestShelveInstance-530934980 None] attachment_update completed successfully. Nov 01 12:33:40 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Delete snapshot completed successfully. Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ee562ac4-0e69-4a63-9ee7-3c4954c46ce1 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-c0b091a4-9c59-45c2-8d93-febd6ae771b9-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] Creating offline snapshot d31667a2-9163-477a-a27c-a2ea1496c28a of volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf1ea66-30ab-409a-8c1f-9ac2be07eaf3]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:41 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:41 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:41 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.391s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:41 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a 1G Nov 01 12:33:41 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:41 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a 1G" returned: 0 in 0.500s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:41 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a Nov 01 12:33:41 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:42 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a" returned: 0 in 0.326s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:42 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a is being set with open permissions: ugo+rw Nov 01 12:33:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:42 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a Nov 01 12:33:42 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:42 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a" returned: 0 in 0.340s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.712s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8e607b35-88ac-4d30-b41d-e26d78cf190c tempest-SnapshotsActionsTest-1508498398 None] Create snapshot completed successfully Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-d31667a2-9163-477a-a27c-a2ea1496c28a-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-d31667a2-9163-477a-a27c-a2ea1496c28a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Acquiring lock "cinder-quobyte-d31667a2-9163-477a-a27c-a2ea1496c28a" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-d31667a2-9163-477a-a27c-a2ea1496c28a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Deleting offline snapshot d31667a2-9163-477a-a27c-a2ea1496c28a of volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] snapshot_file for this snap is: volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[488103ec-75aa-455b-9eb5-5714d1f4298e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:43 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a Nov 01 12:33:43 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:43 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a" returned: 0 in 0.513s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cab3c3a-7acd-4bab-b003-b432bf3c2d09]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:43 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:43 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:44 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.375s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:44 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a Nov 01 12:33:44 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:44 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a" returned: 0 in 0.459s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:44 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a Nov 01 12:33:44 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:44 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.d31667a2-9163-477a-a27c-a2ea1496c28a" returned: 0 in 0.282s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-d31667a2-9163-477a-a27c-a2ea1496c28a" released by "_delete_snapshot" :: held 1.782s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" released by "delete_snapshot" :: held 1.811s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:45 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Created reservations ['cd99b2f8-f4d4-42b9-8da6-379c12f76664', '54491e69-dd46-4113-b46d-b81d59bd68a2', 'c4202c15-a51d-4f78-a480-75548b1733b2', '90b03cf8-b947-471c-9337-c99564819ef3'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:45 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Delete snapshot completed successfully. Nov 01 12:33:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1d1c9632-273b-429f-970a-e29d542c4ba5 tempest-SnapshotsActionsTest-1663278379 None] Lock "cinder-d31667a2-9163-477a-a27c-a2ea1496c28a-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "cinder-db6d7fd5-6233-4622-af46-f18f3eca1fbd-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Lock "cinder-db6d7fd5-6233-4622-af46-f18f3eca1fbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "cinder-quobyte-db6d7fd5-6233-4622-af46-f18f3eca1fbd" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Lock "cinder-quobyte-db6d7fd5-6233-4622-af46-f18f3eca1fbd" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Deleting offline snapshot db6d7fd5-6233-4622-af46-f18f3eca1fbd of volume 50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] snapshot_file for this snap is: volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f7c8d9-32b7-4182-a0a6-873c1e305888]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:46 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:46 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:46 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.431s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bf9bee-091c-4741-bbdd-330ba4a499ea]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:46 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 Nov 01 12:33:46 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:47 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" returned: 0 in 0.436s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:47 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:47 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:47 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.433s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:47 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd Nov 01 12:33:47 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:47 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6.db6d7fd5-6233-4622-af46-f18f3eca1fbd" returned: 0 in 0.328s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Lock "cinder-quobyte-db6d7fd5-6233-4622-af46-f18f3eca1fbd" released by "_delete_snapshot" :: held 1.773s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" released by "delete_snapshot" :: held 1.825s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:47 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Created reservations ['0c3f66eb-d55e-44c7-bcd7-5dab3efa240f', '32c81092-088b-4e73-80e1-0bb4726a94d1', '58a61359-d748-43b5-972a-b649edd74fce', '4858b434-c764-4707-b7ea-5b356ca64bd3'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Delete snapshot completed successfully. Nov 01 12:33:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-025632ff-c86c-495b-aa9a-2681bf910728 tempest-SnapshotsActionsTest-1508498398 None] Lock "cinder-db6d7fd5-6233-4622-af46-f18f3eca1fbd-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "cinder-50e5519b-6df7-4f52-95f4-f5d53adfb3f6-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Lock "cinder-50e5519b-6df7-4f52-95f4-f5d53adfb3f6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:48 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=126,cinder:UPDATE=114,cinder:INSERT=35,cinder:DELETE=6 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:33:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:48 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3172ed-0404-4a4b-9e59-9371680df274]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:48 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 Nov 01 12:33:48 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:48 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" returned: 0 in 0.464s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:48 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6 Nov 01 12:33:48 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:49 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" returned: 0 in 0.311s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Lock "cinder-quobyte-50e5519b-6df7-4f52-95f4-f5d53adfb3f6" released by "delete_volume" :: held 0.851s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Created reservations ['44b12ea3-c49c-4d4a-b40c-fde6392b2b48', '56573b57-f6d0-4d0d-a63a-9bb6c7d9aafb', '37c4cc05-7e47-40ab-8076-e377ac2c0163', 'df18c6f3-7ae3-4d78-999a-e1b009ba74ff'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:49 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:33:49 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:49 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.264s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:49 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Deleted volume successfully. Nov 01 12:33:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7f7284e-7fad-483f-afaa-c6d0e445dab2 tempest-SnapshotsActionsTest-1508498398 None] Lock "cinder-50e5519b-6df7-4f52-95f4-f5d53adfb3f6-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:59 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=62,cinder:UPDATE=45,cinder:DELETE=2,cinder:INSERT=23 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:33:59 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Flow 'volume_create_manager' (114f3a0d-e7cf-4e25-bfd4-0b82bd6a0639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80696c3e-3cf7-44f4-b31a-6627d2ab1ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80696c3e-3cf7-44f4-b31a-6627d2ab1ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-787612235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bbf2ac2-7feb-414d-9af8-9e184517df40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5b5b05d7a442f6b098b4434802a5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:04Z,use_quota=True,user_id='fdca6a70e79d4055bb0004382e63ac5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62827d1a-68e1-484b-b8a6-6c9820d2f221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62827d1a-68e1-484b-b8a6-6c9820d2f221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0525378d-39af-4d5a-8c6d-407bc73b0629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0525378d-39af-4d5a-8c6d-407bc73b0629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bbf2ac2-7feb-414d-9af8-9e184517df40', 'volume_name': 'volume-5bbf2ac2-7feb-414d-9af8-9e184517df40', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5e6d35-8eab-4e71-ae84-039cf2f82df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a5e6d35-8eab-4e71-ae84-039cf2f82df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efb0f89-c450-4768-a6ea-7da0861e3144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:03 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Volume 5bbf2ac2-7feb-414d-9af8-9e184517df40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bbf2ac2-7feb-414d-9af8-9e184517df40', 'volume_size': 1} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-787612235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bbf2ac2-7feb-414d-9af8-9e184517df40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5b5b05d7a442f6b098b4434802a5af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:04Z,use_quota=True,user_id='fdca6a70e79d4055bb0004382e63ac5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Creating volume 5bbf2ac2-7feb-414d-9af8-9e184517df40 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:03 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:34:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:03 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 1073741824 Nov 01 12:34:03 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:04 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 1073741824" returned: 0 in 0.421s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:04 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 Nov 01 12:34:04 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:04 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40" returned: 0 in 0.245s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0efb0f89-c450-4768-a6ea-7da0861e3144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bbf2ac2-7feb-414d-9af8-9e184517df40', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57114ae4-8e81-4261-a6d5-a126701ba182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:04 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Volume volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 (5bbf2ac2-7feb-414d-9af8-9e184517df40): created successfully Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57114ae4-8e81-4261-a6d5-a126701ba182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Flow 'volume_create_manager' (114f3a0d-e7cf-4e25-bfd4-0b82bd6a0639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:04 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f3b9e3e7-8508-4098-9785-5d0fd0db3a13 tempest-SnapshotMetadataTestJSON-675621233 None] Created volume successfully. Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Creating offline snapshot fe5f535e-f843-4cac-9ed9-d59af11096b6 of volume 5bbf2ac2-7feb-414d-9af8-9e184517df40 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f825ddff-1ff1-4904-aa95-c4e588679ba8]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:05 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 Nov 01 12:34:05 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:05 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40" returned: 0 in 0.359s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:05 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 1G Nov 01 12:34:05 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:05 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 1G" returned: 0 in 0.387s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:05 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 Nov 01 12:34:05 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:05 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6" returned: 0 in 0.286s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:05 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 is being set with open permissions: ugo+rw Nov 01 12:34:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:05 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 Nov 01 12:34:05 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:06 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6" returned: 0 in 0.236s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:06 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.info Nov 01 12:34:06 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:06 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.info" returned: 0 in 0.264s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:06 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.info is being set with open permissions: ugo+rw Nov 01 12:34:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:06 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.info Nov 01 12:34:06 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:06 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.info" returned: 0 in 0.245s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:06 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-93ed9de1-cc93-4c01-a321-5bf54378f7b2 tempest-SnapshotMetadataTestJSON-675621233 None] Create snapshot completed successfully Nov 01 12:34:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Acquiring lock "cinder-fe5f535e-f843-4cac-9ed9-d59af11096b6-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "cinder-fe5f535e-f843-4cac-9ed9-d59af11096b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Acquiring lock "cinder-quobyte-5bbf2ac2-7feb-414d-9af8-9e184517df40" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "cinder-quobyte-5bbf2ac2-7feb-414d-9af8-9e184517df40" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Acquiring lock "cinder-quobyte-fe5f535e-f843-4cac-9ed9-d59af11096b6" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "cinder-quobyte-fe5f535e-f843-4cac-9ed9-d59af11096b6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Deleting offline snapshot fe5f535e-f843-4cac-9ed9-d59af11096b6 of volume 5bbf2ac2-7feb-414d-9af8-9e184517df40 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] snapshot_file for this snap is: volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[73462c1a-b95a-421a-9de4-6561c514f979]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:08 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 Nov 01 12:34:08 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:08 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6" returned: 0 in 0.395s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bbf2ac2-7feb-414d-9af8-9e184517df40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f795f811-bae3-4134-9943-9a9908045600]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:08 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 Nov 01 12:34:08 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:08 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40" returned: 0 in 0.379s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:08 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 Nov 01 12:34:08 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:09 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6" returned: 0 in 0.421s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:09 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6 Nov 01 12:34:09 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:09 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40.fe5f535e-f843-4cac-9ed9-d59af11096b6" returned: 0 in 0.394s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "cinder-quobyte-fe5f535e-f843-4cac-9ed9-d59af11096b6" released by "_delete_snapshot" :: held 1.725s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "cinder-quobyte-5bbf2ac2-7feb-414d-9af8-9e184517df40" released by "delete_snapshot" :: held 1.748s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:09 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Created reservations ['e56ae150-679f-49a1-899a-fecb0c52e652', 'dcfa4302-50d7-4a6d-9dfe-a064383aa2ed', '842048af-5597-47bc-978d-af2eb3cf03cd', 'd30c4c6b-2650-44cc-bbde-29fd0dbaf2fa'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Delete snapshot completed successfully. Nov 01 12:34:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e8aa1115-0977-44a6-9be2-b0dc8ed9b035 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "cinder-fe5f535e-f843-4cac-9ed9-d59af11096b6-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Acquiring lock "cinder-5bbf2ac2-7feb-414d-9af8-9e184517df40-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "cinder-5bbf2ac2-7feb-414d-9af8-9e184517df40-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Acquiring lock "cinder-quobyte-5bbf2ac2-7feb-414d-9af8-9e184517df40" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "cinder-quobyte-5bbf2ac2-7feb-414d-9af8-9e184517df40" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:10 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d437d60-45d8-442f-a9c9-b89893140a94]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:10 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 Nov 01 12:34:10 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:10 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40" returned: 0 in 0.432s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:10 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40 Nov 01 12:34:10 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:11 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5bbf2ac2-7feb-414d-9af8-9e184517df40" returned: 0 in 0.404s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "cinder-quobyte-5bbf2ac2-7feb-414d-9af8-9e184517df40" released by "delete_volume" :: held 0.902s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-0b66aac0-edd4-4df9-a1df-00bd5774afbd req-34c65b37-d953-40f8-b0a9-3132789b43d2 tempest-TestShelveInstance-530934980 None] Terminate volume connection completed successfully. Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-0b66aac0-edd4-4df9-a1df-00bd5774afbd req-34c65b37-d953-40f8-b0a9-3132789b43d2 tempest-TestShelveInstance-530934980 None] Deleting attachment 122f83be-dbad-463b-9516-a690e42a284a. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Created reservations ['5e76a9be-ae9a-408e-8566-2d832d3a49bb', '9998ab4a-7038-483e-8ad1-d4dff9aab4e4', '77f9db6c-9ab1-407d-af07-e46d6d56bcaf', 'bd417941-68a0-4f45-88d8-6b05975e9b3b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:11 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:34:11 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:11 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.282s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Deleted volume successfully. Nov 01 12:34:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-473b89a9-1b1d-4344-b4d4-17f1b9586a56 tempest-SnapshotMetadataTestJSON-675621233 None] Lock "cinder-5bbf2ac2-7feb-414d-9af8-9e184517df40-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-238967ac-e226-427d-8d12-492e3832c1c0 req-0e341a40-0950-45ab-9c3a-7822749bc2f0 tempest-TestShelveInstance-530934980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-238967ac-e226-427d-8d12-492e3832c1c0 req-0e341a40-0950-45ab-9c3a-7822749bc2f0 tempest-TestShelveInstance-530934980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-238967ac-e226-427d-8d12-492e3832c1c0 req-0e341a40-0950-45ab-9c3a-7822749bc2f0 tempest-TestShelveInstance-530934980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-238967ac-e226-427d-8d12-492e3832c1c0 req-0e341a40-0950-45ab-9c3a-7822749bc2f0 tempest-TestShelveInstance-530934980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-b593feb3-742d-4ced-8f67-f3e0e4617660', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93ce4bd5-ac23-48bd-89a3-94b19b3bd061', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:34:14 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-238967ac-e226-427d-8d12-492e3832c1c0 req-0e341a40-0950-45ab-9c3a-7822749bc2f0 tempest-TestShelveInstance-530934980 None] attachment_update completed successfully. Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Flow 'volume_create_manager' (51916f72-2658-477a-98e4-5008e137108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656fde26-7a6b-45b3-81df-ff71c865ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (656fde26-7a6b-45b3-81df-ff71c865ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1416195289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4c733a-fb29-4848-9ca4-c77a202c5200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d018df125e2e4e889932c28bc19e656b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:15Z,use_quota=True,user_id='ea4a360a608e4367a3345f6d41ec5c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53d3679-1b67-4345-b4bd-9b5d95635902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53d3679-1b67-4345-b4bd-9b5d95635902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3e71d6-7324-4060-b479-eec6b4bdd53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3e71d6-7324-4060-b479-eec6b4bdd53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4c733a-fb29-4848-9ca4-c77a202c5200', 'volume_name': 'volume-db4c733a-fb29-4848-9ca4-c77a202c5200', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10f60bc-2656-42a1-a830-e69459455965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10f60bc-2656-42a1-a830-e69459455965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34a9603-ceeb-42ee-8310-cd297dafd95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:15 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Volume db4c733a-fb29-4848-9ca4-c77a202c5200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4c733a-fb29-4848-9ca4-c77a202c5200', 'volume_size': 1} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1416195289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4c733a-fb29-4848-9ca4-c77a202c5200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d018df125e2e4e889932c28bc19e656b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:15Z,use_quota=True,user_id='ea4a360a608e4367a3345f6d41ec5c1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Creating volume db4c733a-fb29-4848-9ca4-c77a202c5200 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:15 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:15 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200 1073741824 Nov 01 12:34:15 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:15 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200 1073741824" returned: 0 in 0.471s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:15 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200 Nov 01 12:34:15 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:16 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200" returned: 0 in 0.282s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c34a9603-ceeb-42ee-8310-cd297dafd95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4c733a-fb29-4848-9ca4-c77a202c5200', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcfd56c-6a28-4637-b035-c01519244dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:16 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Volume volume-db4c733a-fb29-4848-9ca4-c77a202c5200 (db4c733a-fb29-4848-9ca4-c77a202c5200): created successfully Nov 01 12:34:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcfd56c-6a28-4637-b035-c01519244dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Flow 'volume_create_manager' (51916f72-2658-477a-98e4-5008e137108a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-af468ed4-2098-4b89-9d0c-0647a7198b1b tempest-VolumesMetadataTest-1074111390 None] Created volume successfully. Nov 01 12:34:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Acquiring lock "cinder-db4c733a-fb29-4848-9ca4-c77a202c5200-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Lock "cinder-db4c733a-fb29-4848-9ca4-c77a202c5200-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Acquiring lock "cinder-quobyte-db4c733a-fb29-4848-9ca4-c77a202c5200" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Lock "cinder-quobyte-db4c733a-fb29-4848-9ca4-c77a202c5200" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:18 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60a89a1-f5dc-40e0-926c-a763086c44da]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:18 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200 Nov 01 12:34:18 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:18 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200" returned: 0 in 0.424s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:18 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200 Nov 01 12:34:18 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:19 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-db4c733a-fb29-4848-9ca4-c77a202c5200" returned: 0 in 0.245s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Lock "cinder-quobyte-db4c733a-fb29-4848-9ca4-c77a202c5200" released by "delete_volume" :: held 0.715s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Created reservations ['e9dcff89-230f-4cf8-af38-5a32e7821cbd', 'aac53c1f-1b62-4edd-8842-26ec073a1958', 'bb79e338-0b86-4875-8a21-bbfdbfc06373', '7057b1da-e3c5-49f8-bcd4-4bf4ed9db338'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:19 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:34:19 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:19 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.304s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:19 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Deleted volume successfully. Nov 01 12:34:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-76277ac7-85ff-491e-b49d-1c3c4a604d3d tempest-VolumesMetadataTest-1074111390 None] Lock "cinder-db4c733a-fb29-4848-9ca4-c77a202c5200-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Flow 'volume_create_manager' (ea7436df-3cee-4b12-9172-3b205108b726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a47c58-427b-41e1-a966-e66b7508f575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a47c58-427b-41e1-a966-e66b7508f575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1992072251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2a3c17-a670-4559-8521-f0a7e1fbc5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c80908efd4b91903375f663ac9524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:25Z,use_quota=True,user_id='fdf5a04fbe0d43c0bf0cb775eb4872c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1745eb5-b28b-4488-8052-9e3f3fd26a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1745eb5-b28b-4488-8052-9e3f3fd26a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94602bfc-6135-47d9-9ffb-f092a13c698c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94602bfc-6135-47d9-9ffb-f092a13c698c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2a3c17-a670-4559-8521-f0a7e1fbc5cd', 'volume_name': 'volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47200602-5505-4231-98b6-eddad372a507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47200602-5505-4231-98b6-eddad372a507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693d8220-d5c0-4574-95fe-fb5b23744430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:24 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Volume cd2a3c17-a670-4559-8521-f0a7e1fbc5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd', 'volume_size': 1} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1992072251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2a3c17-a670-4559-8521-f0a7e1fbc5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c80908efd4b91903375f663ac9524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:25Z,use_quota=True,user_id='fdf5a04fbe0d43c0bf0cb775eb4872c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Creating volume cd2a3c17-a670-4559-8521-f0a7e1fbc5cd {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:24 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:34:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:24 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd 1073741824 Nov 01 12:34:24 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:25 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd 1073741824" returned: 0 in 0.424s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:25 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd Nov 01 12:34:25 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:25 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693d8220-d5c0-4574-95fe-fb5b23744430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b17e4b4-8d80-42b6-a575-b94b6bb46f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Volume volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd (cd2a3c17-a670-4559-8521-f0a7e1fbc5cd): created successfully Nov 01 12:34:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b17e4b4-8d80-42b6-a575-b94b6bb46f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Flow 'volume_create_manager' (ea7436df-3cee-4b12-9172-3b205108b726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-cc8d8e18-74a8-4272-a628-77e5a4615d68 tempest-VolumesTransfersV355Test-1484944465 None] Created volume successfully. Nov 01 12:34:26 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-fc421c52-d592-40f8-ac86-750cb02974c6 tempest-VolumesTransfersV355Test-1263532733 None] Transfer volume completed successfully. Nov 01 12:34:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Acquiring lock "cinder-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Lock "cinder-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Acquiring lock "cinder-quobyte-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Lock "cinder-quobyte-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:26 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[437d5090-cf75-47b8-8c39-c7a86914ae1f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:27 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd Nov 01 12:34:27 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:27 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd" returned: 0 in 0.365s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:27 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd Nov 01 12:34:27 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:27 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd" returned: 0 in 0.266s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Lock "cinder-quobyte-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd" released by "delete_volume" :: held 0.678s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Created reservations ['d2b0182c-99fd-484d-a573-833dcbf6a26c', '0b1f2a69-36b3-47ef-a1cc-8bec31836d09', '79ee0d1b-fd47-4724-bd71-f4b0b594d4e9', '4f02e08b-ebd0-4a9d-add2-fd44b1d20a12'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:27 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:34:27 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:28 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.281s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Deleted volume successfully. Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-add02418-0c64-4ef7-8906-5041cf43d735 tempest-VolumesTransfersV355Test-401301272 None] Lock "cinder-cd2a3c17-a670-4559-8521-f0a7e1fbc5cd-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Flow 'volume_create_manager' (2393283b-3325-4994-9987-070012c5c2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31405e4f-e364-4267-a700-7a32a9ecf97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31405e4f-e364-4267-a700-7a32a9ecf97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1092622820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a378520d-c538-4d5d-ad5d-bca08078809e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c80908efd4b91903375f663ac9524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:29Z,use_quota=True,user_id='fdf5a04fbe0d43c0bf0cb775eb4872c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458e50a8-ff32-41ba-86ea-1be97c7b8b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (458e50a8-ff32-41ba-86ea-1be97c7b8b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca645f7b-ec03-4217-860c-533d8cf1d46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca645f7b-ec03-4217-860c-533d8cf1d46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a378520d-c538-4d5d-ad5d-bca08078809e', 'volume_name': 'volume-a378520d-c538-4d5d-ad5d-bca08078809e', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7693e2-d6b4-4c7d-9103-f651544480c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7693e2-d6b4-4c7d-9103-f651544480c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e70c19-4c2d-48a4-a7d5-d70d5ac659f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:28 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Volume a378520d-c538-4d5d-ad5d-bca08078809e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a378520d-c538-4d5d-ad5d-bca08078809e', 'volume_size': 1} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1092622820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a378520d-c538-4d5d-ad5d-bca08078809e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c80908efd4b91903375f663ac9524',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:29Z,use_quota=True,user_id='fdf5a04fbe0d43c0bf0cb775eb4872c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Creating volume a378520d-c538-4d5d-ad5d-bca08078809e {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:28 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:34:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:28 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e 1073741824 Nov 01 12:34:28 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:29 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e 1073741824" returned: 0 in 0.413s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:29 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e Nov 01 12:34:29 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:29 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e" returned: 0 in 0.261s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e70c19-4c2d-48a4-a7d5-d70d5ac659f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a378520d-c538-4d5d-ad5d-bca08078809e', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21c040a-6d44-459a-857d-bda937799e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:29 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Volume volume-a378520d-c538-4d5d-ad5d-bca08078809e (a378520d-c538-4d5d-ad5d-bca08078809e): created successfully Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21c040a-6d44-459a-857d-bda937799e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Flow 'volume_create_manager' (2393283b-3325-4994-9987-070012c5c2c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:29 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4be4ce32-f5ca-4229-98cc-46591a646ed5 tempest-VolumesTransfersV355Test-1484944465 None] Created volume successfully. Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Acquiring lock "cinder-a378520d-c538-4d5d-ad5d-bca08078809e-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Lock "cinder-a378520d-c538-4d5d-ad5d-bca08078809e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Acquiring lock "cinder-quobyte-a378520d-c538-4d5d-ad5d-bca08078809e" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Lock "cinder-quobyte-a378520d-c538-4d5d-ad5d-bca08078809e" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdf2ca6-7fc1-480e-bcf7-1d00535e8797]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:30 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e Nov 01 12:34:30 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:30 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e" returned: 0 in 0.364s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:30 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e Nov 01 12:34:30 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:30 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a378520d-c538-4d5d-ad5d-bca08078809e" returned: 0 in 0.264s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Lock "cinder-quobyte-a378520d-c538-4d5d-ad5d-bca08078809e" released by "delete_volume" :: held 0.672s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Created reservations ['149b1e34-fb81-4480-84d9-6ca2246a5e57', '2617b797-f516-4292-bbf9-f5dc6cd599ea', '1c19c599-348b-4770-bd88-82c98c33ecdc', '124f2c20-1393-4c53-ab71-6af0e0bf8878'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:30 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:34:30 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:31 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.253s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:31 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:31 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Deleted volume successfully. Nov 01 12:34:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-77b50a19-3914-4031-94d8-c8ac0e5f2dc1 tempest-VolumesTransfersV355Test-401301272 None] Lock "cinder-a378520d-c538-4d5d-ad5d-bca08078809e-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:34:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:37 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:34:37 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Flow 'volume_create_manager' (5b6fd8ce-f04d-4bdc-9745-737632768d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7677e3f4-4c0e-4bf7-87d5-b19a6792d1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7677e3f4-4c0e-4bf7-87d5-b19a6792d1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-909062300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41bfeac7-d303-4c5d-a0af-9f6849c3ee99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b973719d394bfcb13f46a8288ad5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:37Z,use_quota=True,user_id='84370a7eecf34d4b9a729cb5320e0471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:37 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a14bfd2-de3d-4d38-a40d-150cc76761d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a14bfd2-de3d-4d38-a40d-150cc76761d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc8f529-ad69-4b0e-9dd2-d47a23bd2697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.image.glance [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Creating Keystone auth plugin from conf {{(pid=86812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.291s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc8f529-ad69-4b0e-9dd2-d47a23bd2697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41bfeac7-d303-4c5d-a0af-9f6849c3ee99', 'volume_name': 'volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83a2bbd-5887-486c-8ce8-7c00ad29aa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83a2bbd-5887-486c-8ce8-7c00ad29aa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe7c800-4b62-4b90-8ddc-bcabe4da2c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:37 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Volume 41bfeac7-d303-4c5d-a0af-9f6849c3ee99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Trying to clone 41bfeac7-d303-4c5d-a0af-9f6849c3ee99 from image c5fdc172-8826-4b34-a68d-2114e120626b at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]). {{(pid=86812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:34:37 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Image download 20.69 MB at 20.69 MB/s Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2168e6-5c64-4403-bb33-a978a61f9e97]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:38 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD Nov 01 12:34:38 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:38 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Temporary image c5fdc172-8826-4b34-a68d-2114e120626b is fetched for user 84370a7eecf34d4b9a729cb5320e0471. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2cebf2-c406-478e-80f8-0cb32eaeb836]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:38 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD Nov 01 12:34:38 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:38 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-909062300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41bfeac7-d303-4c5d-a0af-9f6849c3ee99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b973719d394bfcb13f46a8288ad5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:37Z,use_quota=True,user_id='84370a7eecf34d4b9a729cb5320e0471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Creating volume 41bfeac7-d303-4c5d-a0af-9f6849c3ee99 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:38 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:34:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:38 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 1073741824 Nov 01 12:34:38 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:39 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 1073741824" returned: 0 in 0.415s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:39 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 Nov 01 12:34:39 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:39 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99" returned: 0 in 0.237s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:39 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Attempting download of c5fdc172-8826-4b34-a68d-2114e120626b ((None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}])) to volume 41bfeac7-d303-4c5d-a0af-9f6849c3ee99. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:34:39 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaab8b11-086a-480f-b446-a4e62b14b1a3]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_lv0dt2fd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:39 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_lv0dt2fd Nov 01 12:34:39 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:39 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_lv0dt2fd" returned: 0 in 0.332s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_lv0dt2fd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:39 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_lv0dt2fd Nov 01 12:34:39 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:40 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_lv0dt2fd" returned: 1 in 0.344s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5fdc172-8826-4b34-a68d-2114e120626b_lv0dt2fd' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:34:40 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9bc470-d23f-4205-b5ec-4cdb3649c7e7]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:40 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD Nov 01 12:34:40 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:40 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:40 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] c5fdc172-8826-4b34-a68d-2114e120626b was qcow2, converting to qcow2 {{(pid=86812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:34:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:40 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 Nov 01 12:34:40 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:42 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99" returned: 0 in 1.830s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5fdc172-8826-4b34-a68d-2114e120626b_zmaoqzc0devstack@QuobyteHD, size 112.00 MB, duration 1.83 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:34:42 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Converted 112.00 MB image at 61.15 MB/s Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:42 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 1G Nov 01 12:34:42 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:42 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 1G" returned: 0 in 0.310s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Downloaded image c5fdc172-8826-4b34-a68d-2114e120626b ((None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}])) to volume 41bfeac7-d303-4c5d-a0af-9f6849c3ee99 successfully. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Temporary image c5fdc172-8826-4b34-a68d-2114e120626b for user 84370a7eecf34d4b9a729cb5320e0471 is deleted. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Marking volume 41bfeac7-d303-4c5d-a0af-9f6849c3ee99 as bootable. {{(pid=86812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Copying metadata from image c5fdc172-8826-4b34-a68d-2114e120626b to 41bfeac7-d303-4c5d-a0af-9f6849c3ee99. {{(pid=86812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Creating volume glance metadata for volume 41bfeac7-d303-4c5d-a0af-9f6849c3ee99 backed by image c5fdc172-8826-4b34-a68d-2114e120626b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe7c800-4b62-4b90-8ddc-bcabe4da2c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99', 'volume_size': 1, 'image_id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5fdc172-8826-4b34-a68d-2114e120626b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7d6ee088343c4394bb2e2cf18894a20d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c5fdc172-8826-4b34-a68d-2114e120626b', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5fdc172-8826-4b34-a68d-2114e120626b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76d203f-0f61-4413-a156-be9e64010ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:42 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Volume volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 (41bfeac7-d303-4c5d-a0af-9f6849c3ee99): created successfully Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76d203f-0f61-4413-a156-be9e64010ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Flow 'volume_create_manager' (5b6fd8ce-f04d-4bdc-9745-737632768d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-56d9ff73-f2e2-4817-96f3-c56cad7adc0b tempest-VolumesExtendTest-242419765 None] Created volume successfully. Nov 01 12:34:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-24304d17-0e93-48d4-be5b-d33eee70597a tempest-VolumesExtendTest-242419765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-24304d17-0e93-48d4-be5b-d33eee70597a tempest-VolumesExtendTest-242419765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:43 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[863b316a-a794-478d-86ee-85eebe19c637]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-24304d17-0e93-48d4-be5b-d33eee70597a tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:43 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 Nov 01 12:34:43 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:43 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-24304d17-0e93-48d4-be5b-d33eee70597a tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99" returned: 0 in 0.360s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-24304d17-0e93-48d4-be5b-d33eee70597a tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 2G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-24304d17-0e93-48d4-be5b-d33eee70597a tempest-VolumesExtendTest-242419765 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 2G" returned: 0 in 0.094s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-24304d17-0e93-48d4-be5b-d33eee70597a tempest-VolumesExtendTest-242419765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.484s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:44 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-24304d17-0e93-48d4-be5b-d33eee70597a tempest-VolumesExtendTest-242419765 None] Extend volume completed successfully. Nov 01 12:34:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Acquiring lock "cinder-41bfeac7-d303-4c5d-a0af-9f6849c3ee99-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Lock "cinder-41bfeac7-d303-4c5d-a0af-9f6849c3ee99-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Acquiring lock "cinder-quobyte-41bfeac7-d303-4c5d-a0af-9f6849c3ee99" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Lock "cinder-quobyte-41bfeac7-d303-4c5d-a0af-9f6849c3ee99" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e2e3e1-5df2-4513-b3d1-d1755176d946]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:45 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 Nov 01 12:34:45 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:45 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99" returned: 0 in 0.361s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:45 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99 Nov 01 12:34:45 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:45 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-41bfeac7-d303-4c5d-a0af-9f6849c3ee99" returned: 0 in 0.244s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Lock "cinder-quobyte-41bfeac7-d303-4c5d-a0af-9f6849c3ee99" released by "delete_volume" :: held 0.645s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Created reservations ['c247b9e4-d27f-4d88-8931-30a44eff496c', 'c28b0a06-bd2c-4195-9f92-46fbea730c73', '46e56dd4-bdee-472d-a247-e08a74858197', '2dd21d8a-2d03-44a5-be9b-f9e0d8361653'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:45 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:34:45 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:45 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:45 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Deleted volume successfully. Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-fc1340a5-85a6-4c77-a00f-8ae368560f7e tempest-VolumesExtendTest-242419765 None] Lock "cinder-41bfeac7-d303-4c5d-a0af-9f6849c3ee99-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Flow 'volume_create_manager' (451bff3f-c7db-4bc5-ac7e-2613e15e93c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bb64c8-baab-4974-9465-455f105255a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bb64c8-baab-4974-9465-455f105255a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-674544541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08437b5b-9f9a-493f-83cd-81db21248c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b973719d394bfcb13f46a8288ad5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:46Z,use_quota=True,user_id='84370a7eecf34d4b9a729cb5320e0471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848e0cc1-4494-40b1-ab64-a055842624b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848e0cc1-4494-40b1-ab64-a055842624b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e628dd1d-5d19-4a64-b013-885ec29ccb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e628dd1d-5d19-4a64-b013-885ec29ccb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08437b5b-9f9a-493f-83cd-81db21248c9c', 'volume_name': 'volume-08437b5b-9f9a-493f-83cd-81db21248c9c', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe637ff-dd1a-462d-9903-4ec4c8a5a9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe637ff-dd1a-462d-9903-4ec4c8a5a9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de53ef2-aeaf-48d6-998d-aed89992c3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Volume 08437b5b-9f9a-493f-83cd-81db21248c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08437b5b-9f9a-493f-83cd-81db21248c9c', 'volume_size': 1} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-674544541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08437b5b-9f9a-493f-83cd-81db21248c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7b973719d394bfcb13f46a8288ad5bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:46Z,use_quota=True,user_id='84370a7eecf34d4b9a729cb5320e0471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Creating volume 08437b5b-9f9a-493f-83cd-81db21248c9c {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:46 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:34:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:46 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c 1073741824 Nov 01 12:34:46 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:46 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c 1073741824" returned: 0 in 0.408s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:47 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c Nov 01 12:34:47 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:47 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c" returned: 0 in 0.239s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de53ef2-aeaf-48d6-998d-aed89992c3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08437b5b-9f9a-493f-83cd-81db21248c9c', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23628ec-c98f-45ac-9dc6-3fa15b9971b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:47 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Volume volume-08437b5b-9f9a-493f-83cd-81db21248c9c (08437b5b-9f9a-493f-83cd-81db21248c9c): created successfully Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23628ec-c98f-45ac-9dc6-3fa15b9971b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Flow 'volume_create_manager' (451bff3f-c7db-4bc5-ac7e-2613e15e93c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:47 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-2ef6f6d9-0854-48ed-9c4d-19365ff7b256 tempest-VolumesExtendTest-242419765 None] Created volume successfully. Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Creating offline snapshot 8c384622-17c5-471b-b68e-191a8c6c5e8e of volume 08437b5b-9f9a-493f-83cd-81db21248c9c {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8e6b4d-c9ee-4fbd-8e5e-11335d6c7e25]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:47 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c Nov 01 12:34:47 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:48 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c" returned: 0 in 0.355s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:48 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e 1G Nov 01 12:34:48 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:48 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e 1G" returned: 0 in 0.383s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08437b5b-9f9a-493f-83cd-81db21248c9c -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:48 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08437b5b-9f9a-493f-83cd-81db21248c9c -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e Nov 01 12:34:48 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:48 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08437b5b-9f9a-493f-83cd-81db21248c9c -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e" returned: 0 in 0.296s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:48 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e is being set with open permissions: ugo+rw Nov 01 12:34:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:48 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e Nov 01 12:34:48 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:49 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e" returned: 0 in 0.242s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:49 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.info Nov 01 12:34:49 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:49 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.info" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:49 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.info is being set with open permissions: ugo+rw Nov 01 12:34:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:49 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.info Nov 01 12:34:49 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:49 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.info" returned: 0 in 0.236s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:49 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8cd09660-44ef-4e16-b570-88eccf60add7 tempest-VolumesExtendTest-242419765 None] Create snapshot completed successfully Nov 01 12:34:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-edbe989d-b76e-44c6-9920-087c65b112c9 tempest-VolumesExtendTest-242419765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-edbe989d-b76e-44c6-9920-087c65b112c9 tempest-VolumesExtendTest-242419765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:49 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6b7317-3f30-40ee-a471-1413b6877449]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-edbe989d-b76e-44c6-9920-087c65b112c9 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:50 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c Nov 01 12:34:50 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:50 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-edbe989d-b76e-44c6-9920-087c65b112c9 tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c" returned: 0 in 0.356s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-edbe989d-b76e-44c6-9920-087c65b112c9 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e 2G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-edbe989d-b76e-44c6-9920-087c65b112c9 tempest-VolumesExtendTest-242419765 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e 2G" returned: 0 in 0.136s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-edbe989d-b76e-44c6-9920-087c65b112c9 tempest-VolumesExtendTest-242419765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.524s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-edbe989d-b76e-44c6-9920-087c65b112c9 tempest-VolumesExtendTest-242419765 None] Extend volume completed successfully. Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Acquiring lock "cinder-8c384622-17c5-471b-b68e-191a8c6c5e8e-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Lock "cinder-8c384622-17c5-471b-b68e-191a8c6c5e8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Acquiring lock "cinder-quobyte-08437b5b-9f9a-493f-83cd-81db21248c9c" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Lock "cinder-quobyte-08437b5b-9f9a-493f-83cd-81db21248c9c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Acquiring lock "cinder-quobyte-8c384622-17c5-471b-b68e-191a8c6c5e8e" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Lock "cinder-quobyte-8c384622-17c5-471b-b68e-191a8c6c5e8e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Deleting offline snapshot 8c384622-17c5-471b-b68e-191a8c6c5e8e of volume 08437b5b-9f9a-493f-83cd-81db21248c9c {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] snapshot_file for this snap is: volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a260c064-99e9-4868-bb14-c41f4ec6ea6b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:51 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e Nov 01 12:34:51 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:51 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e" returned: 0 in 0.380s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08437b5b-9f9a-493f-83cd-81db21248c9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab0c665-066e-4033-b0b9-1c8805065311]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:51 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c Nov 01 12:34:51 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:51 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c" returned: 0 in 0.342s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:51 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e Nov 01 12:34:51 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:52 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e" returned: 0 in 0.349s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:52 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e Nov 01 12:34:52 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:52 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c.8c384622-17c5-471b-b68e-191a8c6c5e8e" returned: 0 in 0.236s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Lock "cinder-quobyte-8c384622-17c5-471b-b68e-191a8c6c5e8e" released by "_delete_snapshot" :: held 1.410s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Lock "cinder-quobyte-08437b5b-9f9a-493f-83cd-81db21248c9c" released by "delete_snapshot" :: held 1.433s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:52 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Created reservations ['f504be41-b2b9-4f6a-8e73-09acddd7eaf1', '75b0783f-d54f-4448-a9f8-8eb3eef6524f', 'f951858c-2257-4321-aeb3-6f231120a257', '98a4b194-f1aa-408f-b762-b3dbbb160fb8'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:52 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Delete snapshot completed successfully. Nov 01 12:34:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ad3311fe-968a-4576-b033-38e7328d3478 tempest-VolumesExtendTest-242419765 None] Lock "cinder-8c384622-17c5-471b-b68e-191a8c6c5e8e-delete_snapshot" released by "delete_snapshot" :: held 1.560s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Acquiring lock "cinder-08437b5b-9f9a-493f-83cd-81db21248c9c-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Lock "cinder-08437b5b-9f9a-493f-83cd-81db21248c9c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Acquiring lock "cinder-quobyte-08437b5b-9f9a-493f-83cd-81db21248c9c" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Lock "cinder-quobyte-08437b5b-9f9a-493f-83cd-81db21248c9c" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dafad2-8f26-4089-814e-c0c2099fce3c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:53 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c Nov 01 12:34:53 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:53 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c" returned: 0 in 0.397s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:53 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c Nov 01 12:34:53 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:54 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-08437b5b-9f9a-493f-83cd-81db21248c9c" returned: 0 in 0.257s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Lock "cinder-quobyte-08437b5b-9f9a-493f-83cd-81db21248c9c" released by "delete_volume" :: held 0.717s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Created reservations ['167d41a8-f9a2-4c00-82cc-70d5665dc98a', 'd571df42-3810-4538-86a8-ad7636e85089', 'e3ab1d84-8a7c-4008-b855-0d604df8cf6f', 'b13034c6-4d72-4143-89fe-43b522e261d1'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:54 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:34:54 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:54 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.249s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:54 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Deleted volume successfully. Nov 01 12:34:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7bd60d40-1718-40e7-bc1d-296960603b26 tempest-VolumesExtendTest-242419765 None] Lock "cinder-08437b5b-9f9a-493f-83cd-81db21248c9c-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:58 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-aff97141-e59a-496c-95b2-fdeb2a0345e3 tempest-TestShelveInstance-530934980 None] Terminate volume connection completed successfully. Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-aff97141-e59a-496c-95b2-fdeb2a0345e3 tempest-TestShelveInstance-530934980 None] Deleting attachment 93ce4bd5-ac23-48bd-89a3-94b19b3bd061. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Acquiring lock "cinder-b593feb3-742d-4ced-8f67-f3e0e4617660-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Lock "cinder-b593feb3-742d-4ced-8f67-f3e0e4617660-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Acquiring lock "cinder-quobyte-b593feb3-742d-4ced-8f67-f3e0e4617660" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Lock "cinder-quobyte-b593feb3-742d-4ced-8f67-f3e0e4617660" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a7643e-ccfd-4bb1-885e-e57229cc66ef]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:58 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 Nov 01 12:34:58 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Flow 'volume_create_manager' (0ed4678d-e058-4899-9917-7b38057c8d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9446cb-b1ce-4fbe-84a1-77c70e408f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9446cb-b1ce-4fbe-84a1-77c70e408f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-376227170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba298382-c1b7-4b53-a777-10a15e3c0caa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7ebe840fe3c41dab5caec842a26db2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:59Z,use_quota=True,user_id='5167921a5ad04dae9239809ac05537df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33073c9a-651c-41ff-8995-5a1162908515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33073c9a-651c-41ff-8995-5a1162908515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbc6864-28cc-4adf-a121-7fe5785a2425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbc6864-28cc-4adf-a121-7fe5785a2425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba298382-c1b7-4b53-a777-10a15e3c0caa', 'volume_name': 'volume-ba298382-c1b7-4b53-a777-10a15e3c0caa', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebf74cf-951e-4459-97da-63f09a644a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebf74cf-951e-4459-97da-63f09a644a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b964495e-5a0e-4474-94ae-3912235768e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:58 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Volume ba298382-c1b7-4b53-a777-10a15e3c0caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba298382-c1b7-4b53-a777-10a15e3c0caa', 'volume_size': 1} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-376227170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba298382-c1b7-4b53-a777-10a15e3c0caa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7ebe840fe3c41dab5caec842a26db2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:59Z,use_quota=True,user_id='5167921a5ad04dae9239809ac05537df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Creating volume ba298382-c1b7-4b53-a777-10a15e3c0caa {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:58 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:58 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa 1073741824 Nov 01 12:34:58 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:58 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660" returned: 0 in 0.430s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:58 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660 Nov 01 12:34:58 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:59 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b593feb3-742d-4ced-8f67-f3e0e4617660" returned: 0 in 0.264s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Lock "cinder-quobyte-b593feb3-742d-4ced-8f67-f3e0e4617660" released by "delete_volume" :: held 0.767s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.quota [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Created reservations ['56b03862-a2a2-44cf-9cb1-7a64d52a564d', 'e6b7b263-f99a-407c-9067-f2aa42e0537d', 'dc67c5cd-4a18-429f-8d4e-7c2be19f97d0', 'd03fc8e8-465c-4ea9-b28a-5dbfc668cdfc'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:59 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa 1073741824" returned: 0 in 0.505s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:59 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:34:59 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:59 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa Nov 01 12:34:59 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:59 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.308s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.manager [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:59 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Deleted volume successfully. Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=99,cinder:SELECT=89,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [req-f52a702d-5b02-436f-bfd8-fc8fa5ae749e req-b019f268-4337-4eea-9d79-2979251ec260 tempest-TestShelveInstance-530934980 None] Lock "cinder-b593feb3-742d-4ced-8f67-f3e0e4617660-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:59 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa" returned: 0 in 0.365s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=85,cinder:UPDATE=98,cinder:DELETE=9,cinder:INSERT=32 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b964495e-5a0e-4474-94ae-3912235768e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba298382-c1b7-4b53-a777-10a15e3c0caa', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93bed5c-465a-46e6-9249-ee5230ec37ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:59 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Volume volume-ba298382-c1b7-4b53-a777-10a15e3c0caa (ba298382-c1b7-4b53-a777-10a15e3c0caa): created successfully Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93bed5c-465a-46e6-9249-ee5230ec37ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Flow 'volume_create_manager' (0ed4678d-e058-4899-9917-7b38057c8d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:59 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-fb6b9924-7516-4b08-a641-349f67c4ede3 tempest-VolumesListTestJSON-679569447 None] Created volume successfully. Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Flow 'volume_create_manager' (856d0cff-73d0-4288-bf29-ee2f6aedea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a078cb2e-c95c-4ab6-a3e6-cb9c2b1eaba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a078cb2e-c95c-4ab6-a3e6-cb9c2b1eaba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-793789882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7ebe840fe3c41dab5caec842a26db2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:01Z,use_quota=True,user_id='5167921a5ad04dae9239809ac05537df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2279d918-1954-48cf-a48b-5fd871855661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2279d918-1954-48cf-a48b-5fd871855661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3865e0ac-853d-476a-830e-5b4065851702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3865e0ac-853d-476a-830e-5b4065851702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1', 'volume_name': 'volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3dcbe2-7766-4ba0-bac7-07f0ff30209a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d3dcbe2-7766-4ba0-bac7-07f0ff30209a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18b1b62-95f7-4915-aa41-48dfb6446b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:01 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Volume ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1', 'volume_size': 1} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-793789882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7ebe840fe3c41dab5caec842a26db2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:01Z,use_quota=True,user_id='5167921a5ad04dae9239809ac05537df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Creating volume ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:01 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:01 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 1073741824 Nov 01 12:35:01 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:01 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 1073741824" returned: 0 in 0.443s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:01 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 Nov 01 12:35:01 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:02 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1" returned: 0 in 0.315s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18b1b62-95f7-4915-aa41-48dfb6446b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b50d9a9-2a21-4aad-b83c-4b77378ed719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:02 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Volume volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 (ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1): created successfully Nov 01 12:35:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b50d9a9-2a21-4aad-b83c-4b77378ed719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Flow 'volume_create_manager' (856d0cff-73d0-4288-bf29-ee2f6aedea4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:02 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-dd600c37-901a-4c11-acba-ab3d73a57a89 tempest-VolumesListTestJSON-679569447 None] Created volume successfully. Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Flow 'volume_create_manager' (343bf71d-054e-4a8a-b32e-3d79abbdfd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52148034-02a1-4965-b1d0-d6fd945c2c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52148034-02a1-4965-b1d0-d6fd945c2c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-663726440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65668e5d-a222-4917-b8b9-3251f3779e69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7ebe840fe3c41dab5caec842a26db2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:04Z,use_quota=True,user_id='5167921a5ad04dae9239809ac05537df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2cdf74-91bc-42b4-9594-d479ae12a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2cdf74-91bc-42b4-9594-d479ae12a19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6500e6e8-4acb-4c7f-9768-d8bfe6580cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6500e6e8-4acb-4c7f-9768-d8bfe6580cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65668e5d-a222-4917-b8b9-3251f3779e69', 'volume_name': 'volume-65668e5d-a222-4917-b8b9-3251f3779e69', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febf27f8-7504-4034-a74e-178bac05cd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (febf27f8-7504-4034-a74e-178bac05cd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857ec09b-bab6-4791-b73c-40762894cba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:04 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Volume 65668e5d-a222-4917-b8b9-3251f3779e69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65668e5d-a222-4917-b8b9-3251f3779e69', 'volume_size': 1} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-663726440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65668e5d-a222-4917-b8b9-3251f3779e69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d7ebe840fe3c41dab5caec842a26db2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:04Z,use_quota=True,user_id='5167921a5ad04dae9239809ac05537df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Creating volume 65668e5d-a222-4917-b8b9-3251f3779e69 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:04 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:04 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69 1073741824 Nov 01 12:35:04 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:04 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69 1073741824" returned: 0 in 0.486s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:04 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69 Nov 01 12:35:04 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:04 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69" returned: 0 in 0.304s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857ec09b-bab6-4791-b73c-40762894cba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65668e5d-a222-4917-b8b9-3251f3779e69', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee61a73e-fb61-4f45-8e34-2b0fd10cc907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:05 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Volume volume-65668e5d-a222-4917-b8b9-3251f3779e69 (65668e5d-a222-4917-b8b9-3251f3779e69): created successfully Nov 01 12:35:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee61a73e-fb61-4f45-8e34-2b0fd10cc907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:05 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Flow 'volume_create_manager' (343bf71d-054e-4a8a-b32e-3d79abbdfd27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:05 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5a2b1c01-f2b3-4a0b-be06-cbd96f8b10d5 tempest-VolumesListTestJSON-679569447 None] Created volume successfully. Nov 01 12:35:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Acquiring lock "cinder-65668e5d-a222-4917-b8b9-3251f3779e69-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Lock "cinder-65668e5d-a222-4917-b8b9-3251f3779e69-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Acquiring lock "cinder-quobyte-65668e5d-a222-4917-b8b9-3251f3779e69" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Lock "cinder-quobyte-65668e5d-a222-4917-b8b9-3251f3779e69" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9d2104-cb45-4b02-a87a-6573098b37fd]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:08 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69 Nov 01 12:35:08 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:08 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69" returned: 0 in 0.399s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:08 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69 Nov 01 12:35:08 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:09 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-65668e5d-a222-4917-b8b9-3251f3779e69" returned: 0 in 0.287s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Lock "cinder-quobyte-65668e5d-a222-4917-b8b9-3251f3779e69" released by "delete_volume" :: held 0.748s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Created reservations ['d4748f87-bcc3-4af1-9051-a8364ed12cc5', '232fad72-9e79-4679-9e09-760f3fffb163', '9a9e04e1-213f-4c41-b468-a1a7fd5bd5cd', '91ce5394-0c4d-4d4e-9822-435479ad90c2'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:09 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:35:09 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:09 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Deleted volume successfully. Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ea2cb2c0-2e16-4777-9872-36522f38139d tempest-VolumesListTestJSON-679569447 None] Lock "cinder-65668e5d-a222-4917-b8b9-3251f3779e69-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Acquiring lock "cinder-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Lock "cinder-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Acquiring lock "cinder-quobyte-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Lock "cinder-quobyte-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1" acquired by "delete_volume" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[20010fcd-0886-468f-be1f-b5d12e17377d]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:09 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 Nov 01 12:35:09 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:10 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1" returned: 0 in 0.396s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:10 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1 Nov 01 12:35:10 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:10 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1" returned: 0 in 0.272s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Lock "cinder-quobyte-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1" released by "delete_volume" :: held 0.740s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Created reservations ['c5dbb6b4-25e8-49f0-b26e-cd245b4a9f37', 'cf5e4bfc-19e6-459e-a207-1ada3f6f520e', 'dcf869ea-46fc-4bb8-aebe-b087e790c482', '468aacc6-26f4-474c-a0cc-d74fb80634d1'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:10 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:35:10 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:10 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.289s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:10 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Deleted volume successfully. Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Acquiring lock "cinder-ba298382-c1b7-4b53-a777-10a15e3c0caa-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451e0329-79a6-41f0-b68f-f0b7883159ef tempest-VolumesListTestJSON-679569447 None] Lock "cinder-ffdee8ec-6086-4a25-ad4b-eaff5b18b4d1-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Lock "cinder-ba298382-c1b7-4b53-a777-10a15e3c0caa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Acquiring lock "cinder-quobyte-ba298382-c1b7-4b53-a777-10a15e3c0caa" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Lock "cinder-quobyte-ba298382-c1b7-4b53-a777-10a15e3c0caa" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18dae93-2bea-461c-aa64-e0f5445a6c85]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:11 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa Nov 01 12:35:11 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:11 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa" returned: 0 in 0.408s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:11 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa Nov 01 12:35:11 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:11 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ba298382-c1b7-4b53-a777-10a15e3c0caa" returned: 0 in 0.258s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Lock "cinder-quobyte-ba298382-c1b7-4b53-a777-10a15e3c0caa" released by "delete_volume" :: held 0.711s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Created reservations ['73e17ad9-79ed-4f16-8c89-2eb07dfbdd17', '405627bc-5fd5-4826-a29a-cd7e11a46d98', '5222c2be-13f4-4cf0-83c4-8479ec96f3f6', '449c0809-62a1-4bb0-93cc-3b4ce720eea6'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:11 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:35:11 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:12 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.292s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:12 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:12 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Deleted volume successfully. Nov 01 12:35:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-19e9a3e9-f517-4b15-8db2-ea9069ea9379 tempest-VolumesListTestJSON-679569447 None] Lock "cinder-ba298382-c1b7-4b53-a777-10a15e3c0caa-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:21 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:DELETE=1,cinder:UPDATE=35,cinder:SELECT=17,cinder:INSERT=5 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:35:22 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=27,cinder:SELECT=21,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Flow 'volume_create_manager' (aabd93ee-7ce5-4883-b4ff-c7c707484c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f558b84d-7442-4212-88d0-272cc010f056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f558b84d-7442-4212-88d0-272cc010f056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-119406297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90d1d58-113e-4821-a3f7-ab9afac6cfa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d298e22eaf4df2a38d01989174f005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:26Z,use_quota=True,user_id='4b0ba79f6f3e4301b9605e3d72d59bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d55411-06e6-4575-b331-9d2da27d6f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62d55411-06e6-4575-b331-9d2da27d6f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e008f12f-6632-499b-91a3-669033b12817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e008f12f-6632-499b-91a3-669033b12817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90d1d58-113e-4821-a3f7-ab9afac6cfa0', 'volume_name': 'volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0747d5fd-632b-4fef-a1f5-ae75f6fcaf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0747d5fd-632b-4fef-a1f5-ae75f6fcaf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797f0713-8aed-4e31-8980-04bec728e5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:26 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume c90d1d58-113e-4821-a3f7-ab9afac6cfa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0', 'volume_size': 1} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-119406297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90d1d58-113e-4821-a3f7-ab9afac6cfa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d298e22eaf4df2a38d01989174f005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:26Z,use_quota=True,user_id='4b0ba79f6f3e4301b9605e3d72d59bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Creating volume c90d1d58-113e-4821-a3f7-ab9afac6cfa0 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:26 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:26 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 1073741824 Nov 01 12:35:26 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:26 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 1073741824" returned: 0 in 0.509s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:26 devstack sudo[103689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 Nov 01 12:35:26 devstack sudo[103689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:27 devstack sudo[103689]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" returned: 0 in 0.369s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (797f0713-8aed-4e31-8980-04bec728e5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131d2ad5-e222-4403-bf44-5790ccf9c012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:27 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 (c90d1d58-113e-4821-a3f7-ab9afac6cfa0): created successfully Nov 01 12:35:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131d2ad5-e222-4403-bf44-5790ccf9c012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Flow 'volume_create_manager' (aabd93ee-7ce5-4883-b4ff-c7c707484c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-560c898f-8f83-4400-a438-9f3a89f5c076 tempest-VolumesSnapshotTestJSON-1382684092 None] Created volume successfully. Nov 01 12:35:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Creating offline snapshot c62d60fa-691b-4687-9d95-2b6cb596bf99 of volume c90d1d58-113e-4821-a3f7-ab9afac6cfa0 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:35:28 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbb8c9d-e8c2-43f2-8ab9-c668d967813a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:28 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 Nov 01 12:35:28 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:29 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" returned: 0 in 0.375s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:29 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 1G Nov 01 12:35:29 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:29 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 1G" returned: 0 in 0.554s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:29 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 Nov 01 12:35:29 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:29 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99" returned: 0 in 0.314s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:29 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 is being set with open permissions: ugo+rw Nov 01 12:35:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:29 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 Nov 01 12:35:29 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:30 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:30 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.info Nov 01 12:35:30 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:30 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.info" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:30 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.info is being set with open permissions: ugo+rw Nov 01 12:35:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:30 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.info Nov 01 12:35:30 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:30 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.info" returned: 0 in 0.272s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:30 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9ceb8473-1b1e-4e47-b6b4-c5208e178e51 tempest-VolumesSnapshotTestJSON-1382684092 None] Create snapshot completed successfully Nov 01 12:35:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-c62d60fa-691b-4687-9d95-2b6cb596bf99-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-c62d60fa-691b-4687-9d95-2b6cb596bf99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-c62d60fa-691b-4687-9d95-2b6cb596bf99" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-c62d60fa-691b-4687-9d95-2b6cb596bf99" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Deleting offline snapshot c62d60fa-691b-4687-9d95-2b6cb596bf99 of volume c90d1d58-113e-4821-a3f7-ab9afac6cfa0 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] snapshot_file for this snap is: volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[724e9f60-985a-491b-b6b0-51638b5955e7]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:32 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 Nov 01 12:35:32 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:32 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99" returned: 0 in 0.377s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8647d5eb-c435-4cc1-99b1-b4747f7b7e5b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:32 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 Nov 01 12:35:32 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:32 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" returned: 0 in 0.388s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:32 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 Nov 01 12:35:32 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:33 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99" returned: 0 in 0.357s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:33 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99 Nov 01 12:35:33 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:33 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0.c62d60fa-691b-4687-9d95-2b6cb596bf99" returned: 0 in 0.283s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-c62d60fa-691b-4687-9d95-2b6cb596bf99" released by "_delete_snapshot" :: held 1.546s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" released by "delete_snapshot" :: held 1.569s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:33 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Created reservations ['587f4cf1-817a-43f4-bdce-0c4153b72129', 'f0a0e193-2e9b-4977-a9ac-702ff2cde370', '276ca0b6-a11f-4265-bd47-e43468a2e2a5', 'fa797439-0488-4649-810d-0e7278e68e3f'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:33 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Delete snapshot completed successfully. Nov 01 12:35:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ae0ed519-0665-4736-b699-562efcf060c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-c62d60fa-691b-4687-9d95-2b6cb596bf99-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Flow 'volume_create_manager' (e4b7d4c3-ca08-4d9b-84bc-6e5799d09dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69afd2a-5f89-482d-85d2-8e9d1192c93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69afd2a-5f89-482d-85d2-8e9d1192c93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1916058636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3431abfd-c4fc-4651-97b7-c6b302b68cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d298e22eaf4df2a38d01989174f005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:35Z,use_quota=True,user_id='4b0ba79f6f3e4301b9605e3d72d59bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad5ecc1-1e3d-4490-b03e-10ed93f16aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fad5ecc1-1e3d-4490-b03e-10ed93f16aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766640ad-183a-4051-a343-496262e03c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (766640ad-183a-4051-a343-496262e03c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3431abfd-c4fc-4651-97b7-c6b302b68cef', 'volume_name': 'volume-3431abfd-c4fc-4651-97b7-c6b302b68cef', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea81f51-78b3-4b78-9f55-d2cbdc4d701d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea81f51-78b3-4b78-9f55-d2cbdc4d701d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2200a4-0de5-442e-9c03-e52848439229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:34 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume 3431abfd-c4fc-4651-97b7-c6b302b68cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3431abfd-c4fc-4651-97b7-c6b302b68cef', 'volume_size': 1} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1916058636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3431abfd-c4fc-4651-97b7-c6b302b68cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d298e22eaf4df2a38d01989174f005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:35Z,use_quota=True,user_id='4b0ba79f6f3e4301b9605e3d72d59bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Creating volume 3431abfd-c4fc-4651-97b7-c6b302b68cef {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:34 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:35:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:34 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef 1073741824 Nov 01 12:35:34 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:35 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef 1073741824" returned: 0 in 0.547s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:35 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef Nov 01 12:35:35 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:35 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef" returned: 0 in 0.290s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2200a4-0de5-442e-9c03-e52848439229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3431abfd-c4fc-4651-97b7-c6b302b68cef', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6dca99-9bc8-4558-a9fc-d1bc9a2c8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:35 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume volume-3431abfd-c4fc-4651-97b7-c6b302b68cef (3431abfd-c4fc-4651-97b7-c6b302b68cef): created successfully Nov 01 12:35:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb6dca99-9bc8-4558-a9fc-d1bc9a2c8927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Flow 'volume_create_manager' (e4b7d4c3-ca08-4d9b-84bc-6e5799d09dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b2792700-fc13-414d-9e17-f790f4b48036 tempest-VolumesSnapshotTestJSON-1382684092 None] Created volume successfully. Nov 01 12:35:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:35:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:37 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:35:37 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Creating offline snapshot 63400f99-b3cf-4316-9c31-4023acb27884 of volume 3431abfd-c4fc-4651-97b7-c6b302b68cef {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[23598994-2901-40d3-8a24-ee1602fc1d59]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:37 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef Nov 01 12:35:37 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:37 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.287s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:35:37 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef" returned: 0 in 0.392s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:37 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 1G Nov 01 12:35:37 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:37 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 1G" returned: 0 in 0.471s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3431abfd-c4fc-4651-97b7-c6b302b68cef -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:37 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3431abfd-c4fc-4651-97b7-c6b302b68cef -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 Nov 01 12:35:37 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Flow 'volume_create_manager' (d2abfa76-053a-4e7d-81f1-ebe68d8f582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1166f430-960a-4ab0-9bfd-60e677bcb8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1166f430-960a-4ab0-9bfd-60e677bcb8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1443001195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be16444-14f0-4f7c-af08-9283719e5235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f12141bf2bd4193ab1765141135ea0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:38Z,use_quota=True,user_id='cbfbe9c344884f338ef879295d159050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fe5e7f-5521-417a-a0a6-8343d6d1ea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fe5e7f-5521-417a-a0a6-8343d6d1ea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44499c22-33fd-40b1-8f66-d7d9e0582827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44499c22-33fd-40b1-8f66-d7d9e0582827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6be16444-14f0-4f7c-af08-9283719e5235', 'volume_name': 'volume-6be16444-14f0-4f7c-af08-9283719e5235', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e4921a-e1be-4418-aa03-b636921c7f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e4921a-e1be-4418-aa03-b636921c7f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c5f81b-70d4-46db-a616-a0544734fdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:38 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Volume 6be16444-14f0-4f7c-af08-9283719e5235: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6be16444-14f0-4f7c-af08-9283719e5235', 'volume_size': 1} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:38 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3431abfd-c4fc-4651-97b7-c6b302b68cef -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884" returned: 0 in 0.332s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:38 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 is being set with open permissions: ugo+rw Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:38 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 Nov 01 12:35:38 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:38 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:38 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.info Nov 01 12:35:38 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:38 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.info" returned: 0 in 0.269s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:38 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.info is being set with open permissions: ugo+rw Nov 01 12:35:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:38 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.info Nov 01 12:35:38 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:39 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.info" returned: 0 in 0.276s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1443001195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6be16444-14f0-4f7c-af08-9283719e5235,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f12141bf2bd4193ab1765141135ea0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:38Z,use_quota=True,user_id='cbfbe9c344884f338ef879295d159050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Creating volume 6be16444-14f0-4f7c-af08-9283719e5235 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:39 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:39 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 1073741824 Nov 01 12:35:39 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-10fae01c-0b4e-4ec9-832a-d9d93e55d8c1 tempest-VolumesSnapshotTestJSON-1382684092 None] Create snapshot completed successfully Nov 01 12:35:39 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 1073741824" returned: 0 in 0.476s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:39 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 Nov 01 12:35:39 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:39 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235" returned: 0 in 0.297s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c5f81b-70d4-46db-a616-a0544734fdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6be16444-14f0-4f7c-af08-9283719e5235', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656d951f-fb1e-414e-b487-dd7f64145a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:40 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Volume volume-6be16444-14f0-4f7c-af08-9283719e5235 (6be16444-14f0-4f7c-af08-9283719e5235): created successfully Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656d951f-fb1e-414e-b487-dd7f64145a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Flow 'volume_create_manager' (d2abfa76-053a-4e7d-81f1-ebe68d8f582c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:40 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-fd90fc02-40dd-4764-ad1d-4cba5be62303 tempest-TestStampPattern-956861796 None] Created volume successfully. Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Flow 'volume_create_manager' (45353401-1c95-4827-877a-c112019193c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411ba670-b4d4-4fe6-b706-7cb8cd0da271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (411ba670-b4d4-4fe6-b706-7cb8cd0da271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1458707940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15c68826-2364-4ae6-8e6b-d0edd8f530a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d298e22eaf4df2a38d01989174f005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=63400f99-b3cf-4316-9c31-4023acb27884,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:41Z,use_quota=True,user_id='4b0ba79f6f3e4301b9605e3d72d59bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6e5d28-ecaa-4f7f-a86e-abece1196c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6e5d28-ecaa-4f7f-a86e-abece1196c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e2c3fb-84bf-4abb-96f3-ae75d5c0f5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e2c3fb-84bf-4abb-96f3-ae75d5c0f5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15c68826-2364-4ae6-8e6b-d0edd8f530a9', 'volume_name': 'volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9', 'volume_size': 2, 'snapshot_id': '63400f99-b3cf-4316-9c31-4023acb27884'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7120031-f98a-41f1-8579-b3d88856a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7120031-f98a-41f1-8579-b3d88856a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03cdc6c-3cc1-4a62-95fd-ccdeeb1ef53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:40 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume 15c68826-2364-4ae6-8e6b-d0edd8f530a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9', 'volume_size': 2, 'snapshot_id': '63400f99-b3cf-4316-9c31-4023acb27884'} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-63400f99-b3cf-4316-9c31-4023acb27884-15c68826-2364-4ae6-8e6b-d0edd8f530a9" by "_create_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-63400f99-b3cf-4316-9c31-4023acb27884-15c68826-2364-4ae6-8e6b-d0edd8f530a9" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Creating volume 15c68826-2364-4ae6-8e6b-d0edd8f530a9 from snapshot 63400f99-b3cf-4316-9c31-4023acb27884 {{(pid=86812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-15c68826-2364-4ae6-8e6b-d0edd8f530a9" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-15c68826-2364-4ae6-8e6b-d0edd8f530a9" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] snapshot: 63400f99-b3cf-4316-9c31-4023acb27884, volume: 15c68826-2364-4ae6-8e6b-d0edd8f530a9, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1212a7f-4eec-42fa-bc30-37daa9598a8b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:41 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 Nov 01 12:35:41 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:41 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884" returned: 0 in 0.369s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3431abfd-c4fc-4651-97b7-c6b302b68cef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:35:41 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b9889c-4acc-464e-b6b8-3b968e9aa3f7]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:41 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef Nov 01 12:35:41 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:41 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef" returned: 0 in 0.397s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:35:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:35:41 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:35:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:41 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 Nov 01 12:35:41 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:50 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9" returned: 0 in 9.040s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:50 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef, size 1024.00 MB, duration 9.04 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:35:50 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Converted 1024.00 MB image at 113.26 MB/s Nov 01 12:35:50 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 is being set with open permissions: ugo+rw Nov 01 12:35:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:50 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 Nov 01 12:35:50 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:50 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=21,cinder:SELECT=27,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:35:50 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=26,cinder:UPDATE=16,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:35:51 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9" returned: 0 in 0.268s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-15c68826-2364-4ae6-8e6b-d0edd8f530a9" released by "_copy_volume_from_snapshot" :: held 10.178s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-63400f99-b3cf-4316-9c31-4023acb27884-15c68826-2364-4ae6-8e6b-d0edd8f530a9" released by "_create_volume_from_snapshot" :: held 10.367s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.392s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03cdc6c-3cc1-4a62-95fd-ccdeeb1ef53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9', 'volume_size': 2, 'snapshot_id': '63400f99-b3cf-4316-9c31-4023acb27884'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65922605-536f-441f-8296-7247d9f378a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:51 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 (15c68826-2364-4ae6-8e6b-d0edd8f530a9): created successfully Nov 01 12:35:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65922605-536f-441f-8296-7247d9f378a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Flow 'volume_create_manager' (45353401-1c95-4827-877a-c112019193c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:51 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6dbf4464-2997-49dc-a1ed-3f53837a4ee5 tempest-VolumesSnapshotTestJSON-1382684092 None] Created volume successfully. Nov 01 12:35:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-15c68826-2364-4ae6-8e6b-d0edd8f530a9-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-15c68826-2364-4ae6-8e6b-d0edd8f530a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-15c68826-2364-4ae6-8e6b-d0edd8f530a9" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-15c68826-2364-4ae6-8e6b-d0edd8f530a9" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:52 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3c6a0f-0963-4d86-8acf-5d266a9ee478]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:52 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 Nov 01 12:35:52 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:52 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9" returned: 0 in 0.406s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:52 devstack sudo[103911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9 Nov 01 12:35:52 devstack sudo[103911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:52 devstack sudo[103911]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-15c68826-2364-4ae6-8e6b-d0edd8f530a9" returned: 0 in 0.273s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-15c68826-2364-4ae6-8e6b-d0edd8f530a9" released by "delete_volume" :: held 0.745s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Created reservations ['9aec7f63-1248-4fe2-aad3-e4538feede9c', '2bdda5a5-037e-4ddb-ac74-141c9b82ece4', '9333c68d-c45d-45c1-be2c-4c869f75d292', 'be7d40c5-474f-49a3-8754-adeb8128e2b5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:53 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:35:53 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-63400f99-b3cf-4316-9c31-4023acb27884-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:53 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.274s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:53 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Deleted volume successfully. Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-63400f99-b3cf-4316-9c31-4023acb27884-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-3431abfd-c4fc-4651-97b7-c6b302b68cef" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9da3fcce-2993-4ccf-b74d-e392605dbe6f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-15c68826-2364-4ae6-8e6b-d0edd8f530a9-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-3431abfd-c4fc-4651-97b7-c6b302b68cef" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-63400f99-b3cf-4316-9c31-4023acb27884" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-63400f99-b3cf-4316-9c31-4023acb27884" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Deleting offline snapshot 63400f99-b3cf-4316-9c31-4023acb27884 of volume 3431abfd-c4fc-4651-97b7-c6b302b68cef {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] snapshot_file for this snap is: volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6450da-8870-4751-ab0e-4bbc00c19e5e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:53 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 Nov 01 12:35:53 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:53 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884" returned: 0 in 0.378s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3431abfd-c4fc-4651-97b7-c6b302b68cef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10a1aef-d9cd-4907-8422-ab14e20da785]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:53 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef Nov 01 12:35:53 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:54 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef" returned: 0 in 0.528s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:54 devstack sudo[103928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 Nov 01 12:35:54 devstack sudo[103928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:54 devstack sudo[103928]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884" returned: 0 in 0.391s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:54 devstack sudo[103936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884 Nov 01 12:35:54 devstack sudo[103936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:55 devstack sudo[103936]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef.63400f99-b3cf-4316-9c31-4023acb27884" returned: 0 in 0.272s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-63400f99-b3cf-4316-9c31-4023acb27884" released by "_delete_snapshot" :: held 1.698s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-3431abfd-c4fc-4651-97b7-c6b302b68cef" released by "delete_snapshot" :: held 1.722s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Created reservations ['d626f2ee-fffd-4242-85c7-a5cc41cccc5e', '7e5d4c40-9042-4ae4-936d-0edb1c92e17d', 'e4243b80-ec70-45d5-b6bf-6e1d27a02c09', '4dbd5d5b-d520-4b5e-93eb-07b9e2db2a12'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:55 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Delete snapshot completed successfully. Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3e063200-a5ce-475e-bf0a-321f19cd0871 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-63400f99-b3cf-4316-9c31-4023acb27884-delete_snapshot" released by "delete_snapshot" :: held 1.912s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-3431abfd-c4fc-4651-97b7-c6b302b68cef-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-3431abfd-c4fc-4651-97b7-c6b302b68cef-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-3431abfd-c4fc-4651-97b7-c6b302b68cef" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-3431abfd-c4fc-4651-97b7-c6b302b68cef" acquired by "delete_volume" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5adfe9-be58-4bf1-9c77-e2637fff9442]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:55 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef Nov 01 12:35:55 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:56 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef" returned: 0 in 0.366s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:56 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef Nov 01 12:35:56 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:56 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3431abfd-c4fc-4651-97b7-c6b302b68cef" returned: 0 in 0.253s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-3431abfd-c4fc-4651-97b7-c6b302b68cef" released by "delete_volume" :: held 0.688s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Created reservations ['9a0dddb6-bebf-420f-9ef6-b25098dcf51d', 'ff5e2aeb-9478-414c-bee9-52d8150c51bc', '451b32d3-6e9f-4b13-bfd3-9b1d40dc604f', '4ee12fd9-3b74-48a5-8ebc-bc3e923fd909'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:56 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:35:56 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:56 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.282s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Deleted volume successfully. Nov 01 12:35:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8cd74d67-fdcd-410d-a756-b550023a35ad tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-3431abfd-c4fc-4651-97b7-c6b302b68cef-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Flow 'volume_create_manager' (b052b3af-6393-4885-a80d-d4c0b496cc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf60671-1130-45d1-8060-a66cce156d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cf60671-1130-45d1-8060-a66cce156d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-37696654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27164679-609d-4dff-b518-54ae4963e609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d298e22eaf4df2a38d01989174f005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:57Z,use_quota=True,user_id='4b0ba79f6f3e4301b9605e3d72d59bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b26fd9-d46b-41ff-9311-0fffb6e6f1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b26fd9-d46b-41ff-9311-0fffb6e6f1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3afc474-5e84-4099-81ad-b345df363bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3afc474-5e84-4099-81ad-b345df363bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27164679-609d-4dff-b518-54ae4963e609', 'volume_name': 'volume-27164679-609d-4dff-b518-54ae4963e609', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69170b88-2cc7-46c7-bd74-80c4d1dbba61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69170b88-2cc7-46c7-bd74-80c4d1dbba61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f6e60f-7fa8-4368-b5de-db249d5a0c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:57 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume 27164679-609d-4dff-b518-54ae4963e609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27164679-609d-4dff-b518-54ae4963e609', 'volume_size': 1} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-37696654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27164679-609d-4dff-b518-54ae4963e609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d298e22eaf4df2a38d01989174f005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:57Z,use_quota=True,user_id='4b0ba79f6f3e4301b9605e3d72d59bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Creating volume 27164679-609d-4dff-b518-54ae4963e609 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:57 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:57 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 1073741824 Nov 01 12:35:57 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:57 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 1073741824" returned: 0 in 0.445s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:57 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 Nov 01 12:35:57 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:58 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609" returned: 0 in 0.239s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f6e60f-7fa8-4368-b5de-db249d5a0c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27164679-609d-4dff-b518-54ae4963e609', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f013f6ee-079e-4fe4-8d5e-1730723d1c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:58 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Volume volume-27164679-609d-4dff-b518-54ae4963e609 (27164679-609d-4dff-b518-54ae4963e609): created successfully Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f013f6ee-079e-4fe4-8d5e-1730723d1c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Flow 'volume_create_manager' (b052b3af-6393-4885-a80d-d4c0b496cc09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:58 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-766ac8d1-ea01-4616-8998-46b8b70c52d4 tempest-VolumesSnapshotTestJSON-1382684092 None] Created volume successfully. Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Creating offline snapshot 25debbcc-5545-43c3-aec6-5f30ede760e4 of volume 27164679-609d-4dff-b518-54ae4963e609 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e90fe9-5f96-4d11-ae9c-21742c8a2dc4]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:58 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 Nov 01 12:35:58 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:58 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609" returned: 0 in 0.396s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:58 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 1G Nov 01 12:35:58 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:59 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 1G" returned: 0 in 0.453s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27164679-609d-4dff-b518-54ae4963e609 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:59 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27164679-609d-4dff-b518-54ae4963e609 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 Nov 01 12:35:59 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:59 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27164679-609d-4dff-b518-54ae4963e609 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4" returned: 0 in 0.308s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:59 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 is being set with open permissions: ugo+rw Nov 01 12:35:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:59 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 Nov 01 12:35:59 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:59 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:00 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.info Nov 01 12:36:00 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:00 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.info" returned: 0 in 0.254s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:00 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.info is being set with open permissions: ugo+rw Nov 01 12:36:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:00 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.info Nov 01 12:36:00 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:00 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.info" returned: 0 in 0.237s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:00 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d8284172-9577-42a4-bc8c-4a8ce33724c8 tempest-VolumesSnapshotTestJSON-1382684092 None] Create snapshot completed successfully Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Flow 'volume_create_manager' (d296cc56-389b-4bbe-a79f-6031183f4e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5eaf2c-0bac-4432-9e77-65eb84de9ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5eaf2c-0bac-4432-9e77-65eb84de9ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-288452431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87eec063-51e0-4711-94d3-a0046ef1035c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d298e22eaf4df2a38d01989174f005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=25debbcc-5545-43c3-aec6-5f30ede760e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:02Z,use_quota=True,user_id='4b0ba79f6f3e4301b9605e3d72d59bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a95686-daea-4570-a7c8-073e941f4519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a95686-daea-4570-a7c8-073e941f4519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80891820-189a-4040-a081-f182b27a2915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80891820-189a-4040-a081-f182b27a2915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '87eec063-51e0-4711-94d3-a0046ef1035c', 'volume_name': 'volume-87eec063-51e0-4711-94d3-a0046ef1035c', 'volume_size': 1, 'snapshot_id': '25debbcc-5545-43c3-aec6-5f30ede760e4'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879cd3da-5383-4c5c-acec-8d8f5dbbea31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879cd3da-5383-4c5c-acec-8d8f5dbbea31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe4c6fc-f3fb-49e6-9782-d67f7ae0edfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:02 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Volume 87eec063-51e0-4711-94d3-a0046ef1035c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-87eec063-51e0-4711-94d3-a0046ef1035c', 'volume_size': 1, 'snapshot_id': '25debbcc-5545-43c3-aec6-5f30ede760e4'} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-25debbcc-5545-43c3-aec6-5f30ede760e4-87eec063-51e0-4711-94d3-a0046ef1035c" by "_create_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-25debbcc-5545-43c3-aec6-5f30ede760e4-87eec063-51e0-4711-94d3-a0046ef1035c" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Creating volume 87eec063-51e0-4711-94d3-a0046ef1035c from snapshot 25debbcc-5545-43c3-aec6-5f30ede760e4 {{(pid=86812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-87eec063-51e0-4711-94d3-a0046ef1035c" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-87eec063-51e0-4711-94d3-a0046ef1035c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] snapshot: 25debbcc-5545-43c3-aec6-5f30ede760e4, volume: 87eec063-51e0-4711-94d3-a0046ef1035c, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb58f084-9832-4c0b-896f-356afe989dd5]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:02 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 Nov 01 12:36:02 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:02 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4" returned: 0 in 0.364s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27164679-609d-4dff-b518-54ae4963e609(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[45950e01-b2e6-4376-894c-909d1e65869d]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:02 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 Nov 01 12:36:02 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:03 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609" returned: 0 in 0.379s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:36:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:36:03 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:36:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:03 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c Nov 01 12:36:03 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:09 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c" returned: 0 in 6.373s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:36:09 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Converted 1024.00 MB image at 160.64 MB/s Nov 01 12:36:09 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c is being set with open permissions: ugo+rw Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:09 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c Nov 01 12:36:09 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:09 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c" returned: 0 in 0.228s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-87eec063-51e0-4711-94d3-a0046ef1035c" released by "_copy_volume_from_snapshot" :: held 7.426s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-25debbcc-5545-43c3-aec6-5f30ede760e4-87eec063-51e0-4711-94d3-a0046ef1035c" released by "_create_volume_from_snapshot" :: held 7.491s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.507s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe4c6fc-f3fb-49e6-9782-d67f7ae0edfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87eec063-51e0-4711-94d3-a0046ef1035c', 'volume_size': 1, 'snapshot_id': '25debbcc-5545-43c3-aec6-5f30ede760e4'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88181cf-89a7-448f-a50e-d8fbbd16a482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:09 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Volume volume-87eec063-51e0-4711-94d3-a0046ef1035c (87eec063-51e0-4711-94d3-a0046ef1035c): created successfully Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88181cf-89a7-448f-a50e-d8fbbd16a482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Flow 'volume_create_manager' (d296cc56-389b-4bbe-a79f-6031183f4e41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f176bad3-0ba3-4bd5-bd13-516b19b1c04d tempest-VolumesSnapshotTestJSON-1382684092 None] Created volume successfully. Nov 01 12:36:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-87eec063-51e0-4711-94d3-a0046ef1035c-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-87eec063-51e0-4711-94d3-a0046ef1035c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-87eec063-51e0-4711-94d3-a0046ef1035c" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-87eec063-51e0-4711-94d3-a0046ef1035c" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5667908c-1025-4938-bf33-fb477395df7e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:11 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c Nov 01 12:36:11 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:11 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c" returned: 0 in 0.342s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:11 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c Nov 01 12:36:11 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:11 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-87eec063-51e0-4711-94d3-a0046ef1035c" returned: 0 in 0.233s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-87eec063-51e0-4711-94d3-a0046ef1035c" released by "delete_volume" :: held 0.614s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Created reservations ['9fd31d7c-cac3-4cfa-8844-461ddcb1d237', '8592bf57-099f-445f-bef8-0fed6d1415a4', '4bdfefc5-884e-43f1-9707-f8800aa757e8', 'f7502ce8-6822-446a-adb3-1365bd6abe04'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:11 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:36:11 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:11 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.241s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Deleted volume successfully. Nov 01 12:36:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-182aa57b-a9bd-41d2-bc8f-b54331551dc9 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-87eec063-51e0-4711-94d3-a0046ef1035c-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-25debbcc-5545-43c3-aec6-5f30ede760e4-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-25debbcc-5545-43c3-aec6-5f30ede760e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-27164679-609d-4dff-b518-54ae4963e609" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-27164679-609d-4dff-b518-54ae4963e609" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-25debbcc-5545-43c3-aec6-5f30ede760e4" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-25debbcc-5545-43c3-aec6-5f30ede760e4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Deleting offline snapshot 25debbcc-5545-43c3-aec6-5f30ede760e4 of volume 27164679-609d-4dff-b518-54ae4963e609 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] snapshot_file for this snap is: volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[115d9a6e-d206-4ff4-a749-3ef39098dd56]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:12 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 Nov 01 12:36:12 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:12 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4" returned: 0 in 0.376s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27164679-609d-4dff-b518-54ae4963e609(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7653aa-fb5a-4f91-bf9a-d2b1030be0da]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:12 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 Nov 01 12:36:12 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-cc7e7ea0-61ef-405a-a233-c5179bbef8d5 req-59bb4059-302c-4c06-8f17-32d5bbb9e5a7 tempest-TestStampPattern-956861796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-cc7e7ea0-61ef-405a-a233-c5179bbef8d5 req-59bb4059-302c-4c06-8f17-32d5bbb9e5a7 tempest-TestStampPattern-956861796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-cc7e7ea0-61ef-405a-a233-c5179bbef8d5 req-59bb4059-302c-4c06-8f17-32d5bbb9e5a7 tempest-TestStampPattern-956861796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-cc7e7ea0-61ef-405a-a233-c5179bbef8d5 req-59bb4059-302c-4c06-8f17-32d5bbb9e5a7 tempest-TestStampPattern-956861796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-6be16444-14f0-4f7c-af08-9283719e5235', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46df0b0b-a82b-4594-9bbb-849b9902cee1', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:36:12 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-cc7e7ea0-61ef-405a-a233-c5179bbef8d5 req-59bb4059-302c-4c06-8f17-32d5bbb9e5a7 tempest-TestStampPattern-956861796 None] attachment_update completed successfully. Nov 01 12:36:13 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609" returned: 0 in 0.555s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:13 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 Nov 01 12:36:13 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:13 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4" returned: 0 in 0.396s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:13 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4 Nov 01 12:36:13 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:13 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609.25debbcc-5545-43c3-aec6-5f30ede760e4" returned: 0 in 0.262s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-25debbcc-5545-43c3-aec6-5f30ede760e4" released by "_delete_snapshot" :: held 1.697s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-27164679-609d-4dff-b518-54ae4963e609" released by "delete_snapshot" :: held 1.719s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:13 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Created reservations ['639a1f88-4b90-4b04-a582-02e963cd1c57', '7a478506-d3e4-404d-8d06-e7adaf5c186f', '857f0b46-72aa-4f4a-9d5a-3940d21dff07', 'b4861352-86fc-4271-b257-d5532c66676b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:13 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Delete snapshot completed successfully. Nov 01 12:36:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9a55976a-db27-4d89-853f-20e8eea77b56 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-25debbcc-5545-43c3-aec6-5f30ede760e4-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-27164679-609d-4dff-b518-54ae4963e609-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-27164679-609d-4dff-b518-54ae4963e609-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-27164679-609d-4dff-b518-54ae4963e609" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-27164679-609d-4dff-b518-54ae4963e609" acquired by "delete_volume" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:14 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c02fc9e-e880-490f-9d1e-b1fd4c440d7d]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:14 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 Nov 01 12:36:14 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:14 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609" returned: 0 in 0.371s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:14 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609 Nov 01 12:36:14 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:15 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-27164679-609d-4dff-b518-54ae4963e609" returned: 0 in 0.260s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-27164679-609d-4dff-b518-54ae4963e609" released by "delete_volume" :: held 0.692s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Created reservations ['a75bc2e7-f356-421f-8d54-cb40ce5d6b5d', '430f1de5-36db-45fb-9445-5071947c80df', '22e4327e-1585-42c1-a2a7-19298ca7b12c', '628cb6e3-dacd-456e-a85c-fe3290db7670'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:15 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:36:15 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:15 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.262s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:15 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Deleted volume successfully. Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a5a7a130-5709-44b3-9efb-5d2c4366b56f tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-27164679-609d-4dff-b518-54ae4963e609-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-c90d1d58-113e-4821-a3f7-ab9afac6cfa0-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-c90d1d58-113e-4821-a3f7-ab9afac6cfa0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "cinder-quobyte-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1206512b-bcf3-4c94-ab2c-61b5365c4614]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:15 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 Nov 01 12:36:15 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:16 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" returned: 0 in 0.400s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:16 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0 Nov 01 12:36:16 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:16 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" returned: 0 in 0.261s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-quobyte-c90d1d58-113e-4821-a3f7-ab9afac6cfa0" released by "delete_volume" :: held 0.729s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Created reservations ['6969770c-8735-47e0-875f-b17aea7ae969', 'e4e5c404-5eb2-4de8-bed0-f8f5a795f6d6', 'a1350cb7-5b62-47b8-95f6-7f305e30750f', '87282e8f-11fe-4755-ac7b-2632bc3c4f87'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:16 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:36:16 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:16 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.293s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Deleted volume successfully. Nov 01 12:36:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b8ad2a1f-88ed-46cf-8608-e10b654bdb44 tempest-VolumesSnapshotTestJSON-1382684092 None] Lock "cinder-c90d1d58-113e-4821-a3f7-ab9afac6cfa0-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:18 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-9973be86-d7f1-48cf-8c99-cd6987e00328 req-fc903a92-12a9-4661-aa61-2a7e2c3e978b tempest-TestStampPattern-956861796 None] Terminate volume connection completed successfully. Nov 01 12:36:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-9973be86-d7f1-48cf-8c99-cd6987e00328 req-fc903a92-12a9-4661-aa61-2a7e2c3e978b tempest-TestStampPattern-956861796 None] Deleting attachment 46df0b0b-a82b-4594-9bbb-849b9902cee1. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:36:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Creating offline snapshot 0c3709ab-d68c-4d32-a471-b42ebfc52688 of volume 6be16444-14f0-4f7c-af08-9283719e5235 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:36:19 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ba36e1-e940-44dc-8ab7-b943f4eb8c40]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:19 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 Nov 01 12:36:19 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:19 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235" returned: 0 in 0.366s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:19 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 1G Nov 01 12:36:19 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:20 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 1G" returned: 0 in 0.414s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6be16444-14f0-4f7c-af08-9283719e5235 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:20 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6be16444-14f0-4f7c-af08-9283719e5235 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 Nov 01 12:36:20 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:20 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6be16444-14f0-4f7c-af08-9283719e5235 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688" returned: 0 in 0.338s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:20 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 is being set with open permissions: ugo+rw Nov 01 12:36:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:20 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 Nov 01 12:36:20 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:20 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688" returned: 0 in 0.270s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:20 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.info Nov 01 12:36:20 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:21 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.info" returned: 0 in 0.272s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:21 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.info is being set with open permissions: ugo+rw Nov 01 12:36:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:21 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.info Nov 01 12:36:21 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:21 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.info" returned: 0 in 0.288s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:21 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0d03ffae-1edc-4fe8-bba1-8ec58cd7c044 tempest-TestStampPattern-956861796 None] Create snapshot completed successfully Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Flow 'volume_create_manager' (40386c7e-8942-4698-bdb4-806542958abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c21294-f387-485d-9755-e95a94841777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c21294-f387-485d-9755-e95a94841777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-926419685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87b77ed-2c8a-4e95-8a17-251173fa5f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1e414b6eec45219e2d16bab70c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:24Z,use_quota=True,user_id='7fcc0c8bcb50459e9a5f14573153e406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea2f37a-3e26-4987-b9bc-7129d86f0192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea2f37a-3e26-4987-b9bc-7129d86f0192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e878f9-88a3-413b-acf5-e53654b129b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e878f9-88a3-413b-acf5-e53654b129b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87b77ed-2c8a-4e95-8a17-251173fa5f90', 'volume_name': 'volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d88fd3-f275-421c-8f78-1cb54308c760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d88fd3-f275-421c-8f78-1cb54308c760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7264d77-6003-4373-b4ff-e2f4fd833a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:24 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Volume d87b77ed-2c8a-4e95-8a17-251173fa5f90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90', 'volume_size': 1} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-926419685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87b77ed-2c8a-4e95-8a17-251173fa5f90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1e414b6eec45219e2d16bab70c921f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:24Z,use_quota=True,user_id='7fcc0c8bcb50459e9a5f14573153e406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Creating volume d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:36:24 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:36:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:24 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 1073741824 Nov 01 12:36:24 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:25 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 1073741824" returned: 0 in 0.473s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:25 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 Nov 01 12:36:25 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:25 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90" returned: 0 in 0.243s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:36:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7264d77-6003-4373-b4ff-e2f4fd833a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb761ff-a681-4633-bd5a-8d824ca66f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Volume volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 (d87b77ed-2c8a-4e95-8a17-251173fa5f90): created successfully Nov 01 12:36:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb761ff-a681-4633-bd5a-8d824ca66f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Flow 'volume_create_manager' (40386c7e-8942-4698-bdb4-806542958abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-cec48874-980b-4550-803c-f8bdaf881c94 tempest-VolumesSnapshotListTestJSON-1602764984 None] Created volume successfully. Nov 01 12:36:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Creating offline snapshot 3060e04b-aeee-4cbf-a49a-4b803e92ef58 of volume d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:36:26 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[65984af5-dd21-4dc2-acfa-1fb65b959a64]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:26 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 Nov 01 12:36:26 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:27 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90" returned: 0 in 0.396s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:27 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 1G Nov 01 12:36:27 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:27 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 1G" returned: 0 in 0.443s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:27 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 Nov 01 12:36:27 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:27 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58" returned: 0 in 0.312s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:27 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 is being set with open permissions: ugo+rw Nov 01 12:36:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:27 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 Nov 01 12:36:27 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:28 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58" returned: 0 in 0.234s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:28 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.info Nov 01 12:36:28 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:28 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.info" returned: 0 in 0.249s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:28 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.info is being set with open permissions: ugo+rw Nov 01 12:36:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:28 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.info Nov 01 12:36:28 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:28 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.info" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8ddc4a84-ca71-466b-8196-aaedf018bfa9 tempest-VolumesSnapshotListTestJSON-1602764984 None] Create snapshot completed successfully Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] Creating offline snapshot a8af946b-422c-473e-8e39-fa1764a581fc of volume d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce96da9-2842-4230-92c2-c822817e8b99]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:36:29 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 Nov 01 12:36:29 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Flow 'volume_create_manager' (ee2de79b-d10d-4434-8f59-8a9b0c6d721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa18c240-2e66-43fa-914a-99e1ce174790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa18c240-2e66-43fa-914a-99e1ce174790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1540848147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3059cd5d-c2cd-4eec-8bf9-c07af0615cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f12141bf2bd4193ab1765141135ea0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0c3709ab-d68c-4d32-a471-b42ebfc52688,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:29Z,use_quota=True,user_id='cbfbe9c344884f338ef879295d159050',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ab03e6-61ac-4f87-81b9-2d29c4317bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ab03e6-61ac-4f87-81b9-2d29c4317bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bde6e0-21e8-4331-8117-bec4c98e1759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bde6e0-21e8-4331-8117-bec4c98e1759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3059cd5d-c2cd-4eec-8bf9-c07af0615cd5', 'volume_name': 'volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5', 'volume_size': 1, 'snapshot_id': '0c3709ab-d68c-4d32-a471-b42ebfc52688'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea36b4d0-9454-465a-a35b-893fbe602d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea36b4d0-9454-465a-a35b-893fbe602d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7297b0ae-cf86-403d-b16f-2382779fd6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:29 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Volume 3059cd5d-c2cd-4eec-8bf9-c07af0615cd5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5', 'volume_size': 1, 'snapshot_id': '0c3709ab-d68c-4d32-a471-b42ebfc52688'} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:29 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58" returned: 0 in 0.395s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:29 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc 1G Nov 01 12:36:29 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:30 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc 1G" returned: 0 in 0.508s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:30 devstack sudo[104713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc Nov 01 12:36:30 devstack sudo[104713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:30 devstack sudo[104713]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc" returned: 0 in 0.297s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:30 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc is being set with open permissions: ugo+rw Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:30 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc Nov 01 12:36:30 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:30 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.572s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.281s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Acquiring lock "cinder-quobyte-0c3709ab-d68c-4d32-a471-b42ebfc52688-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" by "_create_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-0c3709ab-d68c-4d32-a471-b42ebfc52688-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Creating volume 3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 from snapshot 0c3709ab-d68c-4d32-a471-b42ebfc52688 {{(pid=86812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Acquiring lock "cinder-quobyte-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:30 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-72507f6d-33b2-4504-a71d-7789518d0738 tempest-VolumesSnapshotListTestJSON-1602764984 None] Create snapshot completed successfully Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] snapshot: 0c3709ab-d68c-4d32-a471-b42ebfc52688, volume: 3059cd5d-c2cd-4eec-8bf9-c07af0615cd5, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24e21bb-dfd9-4482-812e-7b01a5e8fb28]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:30 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 Nov 01 12:36:30 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:31 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688" returned: 0 in 0.441s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6be16444-14f0-4f7c-af08-9283719e5235(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:31 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff55872-6f13-4f3a-9574-0dbb426f4e49]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:31 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 Nov 01 12:36:31 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:31 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235" returned: 0 in 0.453s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:36:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:36:31 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:36:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:31 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 Nov 01 12:36:31 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:36:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:37 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:36:37 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:37 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.591s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:36:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:36:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:36:40 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" returned: 0 in 8.953s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:40 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235, size 1024.00 MB, duration 8.95 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:36:40 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Converted 1024.00 MB image at 114.37 MB/s Nov 01 12:36:40 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 is being set with open permissions: ugo+rw Nov 01 12:36:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:40 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 Nov 01 12:36:40 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:40 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" returned: 0 in 0.265s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" released by "_copy_volume_from_snapshot" :: held 10.219s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-0c3709ab-d68c-4d32-a471-b42ebfc52688-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" released by "_create_volume_from_snapshot" :: held 10.299s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.328s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.620s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] Creating offline snapshot df9ff0b9-0130-4a2a-a268-dac9c6d732ab of volume d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7297b0ae-cf86-403d-b16f-2382779fd6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5', 'volume_size': 1, 'snapshot_id': '0c3709ab-d68c-4d32-a471-b42ebfc52688'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01c25f6-c029-4d90-94e0-a94e2e9fb220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4972002-71d4-4848-b279-a9f0a1fe9456]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:41 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Volume volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 (3059cd5d-c2cd-4eec-8bf9-c07af0615cd5): created successfully Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01c25f6-c029-4d90-94e0-a94e2e9fb220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Flow 'volume_create_manager' (ee2de79b-d10d-4434-8f59-8a9b0c6d721f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:41 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-112afafc-acdf-4cb7-b8a6-fce7aab3bac4 tempest-TestStampPattern-956861796 None] Created volume successfully. Nov 01 12:36:41 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc Nov 01 12:36:41 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:41 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc" returned: 0 in 0.454s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:41 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab 1G Nov 01 12:36:41 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:42 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab 1G" returned: 0 in 0.544s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:42 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab Nov 01 12:36:42 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:42 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab" returned: 0 in 0.366s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:42 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab is being set with open permissions: ugo+rw Nov 01 12:36:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:42 devstack sudo[104842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab Nov 01 12:36:42 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:42 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab" returned: 0 in 0.293s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-38e41310-6cea-4edb-97d7-77b74ce875fa tempest-VolumesSnapshotListTestJSON-1602764984 None] Create snapshot completed successfully Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-df9ff0b9-0130-4a2a-a268-dac9c6d732ab-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-df9ff0b9-0130-4a2a-a268-dac9c6d732ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-quobyte-df9ff0b9-0130-4a2a-a268-dac9c6d732ab" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-df9ff0b9-0130-4a2a-a268-dac9c6d732ab" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Deleting offline snapshot df9ff0b9-0130-4a2a-a268-dac9c6d732ab of volume d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] snapshot_file for this snap is: volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e2d772-8765-4fd0-8a13-998d5b58049f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:44 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab Nov 01 12:36:44 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:44 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab" returned: 0 in 0.365s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[241af2a8-fa47-4677-a87a-326a109ae6e6]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:44 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc Nov 01 12:36:44 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:45 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc" returned: 0 in 0.358s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:45 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab Nov 01 12:36:45 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:45 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab" returned: 0 in 0.402s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:45 devstack sudo[104864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab Nov 01 12:36:45 devstack sudo[104864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:45 devstack sudo[104864]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.df9ff0b9-0130-4a2a-a268-dac9c6d732ab" returned: 0 in 0.235s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-df9ff0b9-0130-4a2a-a268-dac9c6d732ab" released by "_delete_snapshot" :: held 1.455s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" released by "delete_snapshot" :: held 1.485s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:45 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Created reservations ['9de641a6-bbab-4d4e-8c84-7bc2aabca975', '0faf4888-1d12-4988-bcc4-fa84e674a115', '6030d5b0-0f72-4a12-9970-5c4eda96f04f', '56a5968e-a243-4497-96ff-22c45fee9ee7'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:45 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Delete snapshot completed successfully. Nov 01 12:36:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7899a183-da2e-48aa-8c4c-e29abd5d2965 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-df9ff0b9-0130-4a2a-a268-dac9c6d732ab-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-a8af946b-422c-473e-8e39-fa1764a581fc-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-a8af946b-422c-473e-8e39-fa1764a581fc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-quobyte-a8af946b-422c-473e-8e39-fa1764a581fc" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-a8af946b-422c-473e-8e39-fa1764a581fc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Deleting offline snapshot a8af946b-422c-473e-8e39-fa1764a581fc of volume d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] snapshot_file for this snap is: volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3604bc-d31d-4181-a1dd-8d2754a7405f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:46 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc Nov 01 12:36:46 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:46 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc" returned: 0 in 0.371s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b67d25-5aff-4b99-8d9f-554a33e28739]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:46 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 Nov 01 12:36:46 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:47 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58" returned: 0 in 0.350s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:47 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc Nov 01 12:36:47 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:47 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc" returned: 0 in 0.383s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:47 devstack sudo[104882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc Nov 01 12:36:47 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:47 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.a8af946b-422c-473e-8e39-fa1764a581fc" returned: 0 in 0.243s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-a8af946b-422c-473e-8e39-fa1764a581fc" released by "_delete_snapshot" :: held 1.454s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" released by "delete_snapshot" :: held 1.482s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:47 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Created reservations ['464fffd9-92ca-4b59-a4d9-f21eea271f75', '7abfec53-c04b-47dd-b083-1306c9c83514', '2ff1966e-4eb5-4c75-b8dd-ad29c0f7627a', 'cb94bef1-db6f-488d-84c8-2f6f9ddaf23b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:47 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Delete snapshot completed successfully. Nov 01 12:36:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0ae550aa-2b7a-488c-a427-98b765093a53 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-a8af946b-422c-473e-8e39-fa1764a581fc-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-3060e04b-aeee-4cbf-a49a-4b803e92ef58-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-3060e04b-aeee-4cbf-a49a-4b803e92ef58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-quobyte-3060e04b-aeee-4cbf-a49a-4b803e92ef58" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-3060e04b-aeee-4cbf-a49a-4b803e92ef58" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Deleting offline snapshot 3060e04b-aeee-4cbf-a49a-4b803e92ef58 of volume d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:36:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] snapshot_file for this snap is: volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:36:48 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c92a89-08a2-40f2-aad4-dd05e2d32316]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:48 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 Nov 01 12:36:48 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:49 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58" returned: 0 in 0.383s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:49 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5a75ee-0f1a-4446-a97e-b994f6257e7c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:49 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 Nov 01 12:36:49 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:49 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90" returned: 0 in 0.376s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:49 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 Nov 01 12:36:49 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:49 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58" returned: 0 in 0.347s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:49 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58 Nov 01 12:36:49 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:50 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90.3060e04b-aeee-4cbf-a49a-4b803e92ef58" returned: 0 in 0.253s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-3060e04b-aeee-4cbf-a49a-4b803e92ef58" released by "_delete_snapshot" :: held 1.472s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" released by "delete_snapshot" :: held 1.495s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Created reservations ['65266e29-8bca-400c-8817-d74a76f0fe3a', '12c3a830-3402-48bf-b76b-6a5e3876fb84', '98c1f1de-a005-45b8-b7c1-f9aded5ee087', '2189c690-81be-4020-a917-ffbe1eee0ddd'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Delete snapshot completed successfully. Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-75970580-9de6-47a3-8a49-05afa2ebfa5f tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-3060e04b-aeee-4cbf-a49a-4b803e92ef58-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-d87b77ed-2c8a-4e95-8a17-251173fa5f90-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-d87b77ed-2c8a-4e95-8a17-251173fa5f90-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe21ee-09fe-4bba-acee-45b7ae65ce3a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:51 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 Nov 01 12:36:51 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:51 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90" returned: 0 in 0.358s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:51 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90 Nov 01 12:36:51 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:51 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d87b77ed-2c8a-4e95-8a17-251173fa5f90" returned: 0 in 0.242s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-quobyte-d87b77ed-2c8a-4e95-8a17-251173fa5f90" released by "delete_volume" :: held 0.669s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=91,cinder:INSERT=28,cinder:UPDATE=93,cinder:DELETE=7 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=89,cinder:SELECT=86,cinder:INSERT=20,cinder:DELETE=8 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Created reservations ['5b7df950-f3ea-4c62-8784-e86584a03611', '1093f431-6365-4d9c-82c8-44b09c8c7ea3', '3fc19eb9-952e-4802-a6c3-b56f3b015ced', '9ba5d603-ecef-4eb9-8f80-9c9cddc37ea8'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:51 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:36:51 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:51 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:51 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Deleted volume successfully. Nov 01 12:36:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-79297707-ee21-433a-aca8-e6d06b206291 tempest-VolumesSnapshotListTestJSON-1602764984 None] Lock "cinder-d87b77ed-2c8a-4e95-8a17-251173fa5f90-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Flow 'volume_create_manager' (056b9bfc-8e95-404c-bdb0-60c36bde38c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b02acfb-7546-4ed9-81a5-fd895d786799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b02acfb-7546-4ed9-81a5-fd895d786799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1643027038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee0f81d-ec25-42ae-a4dd-182cfcfe0742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c530fc69125744419fa09827b91ef463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:55Z,use_quota=True,user_id='2be0af7da81f4eeaa83ba56f90a77910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf06abd4-3768-4c11-857c-d01f2231f90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf06abd4-3768-4c11-857c-d01f2231f90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9dbcef-f6ac-49e4-a4dd-18d35f6b4050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9dbcef-f6ac-49e4-a4dd-18d35f6b4050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee0f81d-ec25-42ae-a4dd-182cfcfe0742', 'volume_name': 'volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742', 'volume_size': 2}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d167099b-6fd4-4f6f-b7a7-e36b00911ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d167099b-6fd4-4f6f-b7a7-e36b00911ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841f50ba-ef16-4b8d-bf72-2777eae33a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:55 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Volume 7ee0f81d-ec25-42ae-a4dd-182cfcfe0742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742', 'volume_size': 2} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1643027038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee0f81d-ec25-42ae-a4dd-182cfcfe0742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c530fc69125744419fa09827b91ef463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:55Z,use_quota=True,user_id='2be0af7da81f4eeaa83ba56f90a77910',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Creating volume 7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:36:55 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:36:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 2147483648 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:55 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 2147483648 Nov 01 12:36:55 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:56 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 2147483648" returned: 0 in 0.447s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:56 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 Nov 01 12:36:56 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:56 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" returned: 0 in 0.238s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841f50ba-ef16-4b8d-bf72-2777eae33a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742', 'volume_size': 2}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aef0ffc-6c02-4f7b-92fb-a712df8f92bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:56 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Volume volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 (7ee0f81d-ec25-42ae-a4dd-182cfcfe0742): created successfully Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aef0ffc-6c02-4f7b-92fb-a712df8f92bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Flow 'volume_create_manager' (056b9bfc-8e95-404c-bdb0-60c36bde38c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6033da07-fd9d-4e6c-adbd-14aa6ebc744d tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Created volume successfully. Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Creating offline snapshot 8b6b41dc-4468-4030-b13b-07f3ae5efce5 of volume 7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f513e10-295f-4c61-a6c1-e5effdf70936]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:56 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 Nov 01 12:36:56 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:57 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" returned: 0 in 0.365s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 2G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:57 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 2G Nov 01 12:36:57 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:57 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 2G" returned: 0 in 0.423s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:57 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 Nov 01 12:36:57 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:57 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5" returned: 0 in 0.300s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:57 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 is being set with open permissions: ugo+rw Nov 01 12:36:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:57 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 Nov 01 12:36:57 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:58 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5" returned: 0 in 0.236s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:58 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.info Nov 01 12:36:58 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:58 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.info" returned: 0 in 0.248s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:58 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.info is being set with open permissions: ugo+rw Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:58 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.info Nov 01 12:36:58 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:58 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.info" returned: 0 in 0.232s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:58 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9bcee03a-47cb-4391-b644-ee7258ea9a3f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Create snapshot completed successfully Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Acquiring lock "cinder-8b6b41dc-4468-4030-b13b-07f3ae5efce5-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "cinder-8b6b41dc-4468-4030-b13b-07f3ae5efce5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Acquiring lock "cinder-quobyte-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "cinder-quobyte-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Acquiring lock "cinder-quobyte-8b6b41dc-4468-4030-b13b-07f3ae5efce5" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "cinder-quobyte-8b6b41dc-4468-4030-b13b-07f3ae5efce5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Deleting offline snapshot 8b6b41dc-4468-4030-b13b-07f3ae5efce5 of volume 7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] snapshot_file for this snap is: volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a84c11-a134-4dda-ad8d-1a49d93a5b1f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:59 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 Nov 01 12:36:59 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:59 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5" returned: 0 in 0.347s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:36:59 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed2218e-9a85-4249-9d5c-ee81154dc99e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:59 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 Nov 01 12:36:59 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:59 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" returned: 0 in 0.342s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:59 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 Nov 01 12:36:59 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:00 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5" returned: 0 in 0.329s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:00 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5 Nov 01 12:37:00 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:00 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742.8b6b41dc-4468-4030-b13b-07f3ae5efce5" returned: 0 in 0.237s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "cinder-quobyte-8b6b41dc-4468-4030-b13b-07f3ae5efce5" released by "_delete_snapshot" :: held 1.359s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "cinder-quobyte-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" released by "delete_snapshot" :: held 1.379s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:00 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Created reservations ['1b5d2996-c8eb-454e-9b96-6c54875723d1', '3381dc79-7365-47e6-b975-c189e0667b39', 'd16e4a4f-c4a9-41a2-8d2c-db74952015d7', 'c444b675-69dc-43e0-9bc4-74e4ae5db59a'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:00 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Delete snapshot completed successfully. Nov 01 12:37:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-cc01b8dd-d7f7-4763-9803-2a6fffc96a2f tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "cinder-8b6b41dc-4468-4030-b13b-07f3ae5efce5-delete_snapshot" released by "delete_snapshot" :: held 1.500s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Acquiring lock "cinder-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "cinder-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Acquiring lock "cinder-quobyte-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "cinder-quobyte-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb09ec92-59ed-45f9-9f38-4061ce21c160]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:01 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 Nov 01 12:37:01 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:01 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" returned: 0 in 0.378s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:01 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742 Nov 01 12:37:01 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:01 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "cinder-quobyte-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742" released by "delete_volume" :: held 0.694s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Created reservations ['1c0b3f0c-42f2-4bc9-91dc-e54da3b21aa8', '24f54f94-b6bc-4c89-907e-2e4c9a6252ea', 'cff853e6-9328-4cc9-9b1f-3fccf770557f', '0070779d-cd72-4ea3-a37d-58a954ab2238'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:01 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:37:01 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:02 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:02 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:02 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Deleted volume successfully. Nov 01 12:37:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-54ebeec3-1e03-4372-81d1-58ae8f681f9b tempest-VolumesSnapshotNegativeTestJSON-287284120 None] Lock "cinder-7ee0f81d-ec25-42ae-a4dd-182cfcfe0742-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-a59b4937-3fee-480b-8042-271f7a1a484d req-da86f2bd-e2cc-4373-a3af-cc199f347d19 tempest-TestStampPattern-956861796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-a59b4937-3fee-480b-8042-271f7a1a484d req-da86f2bd-e2cc-4373-a3af-cc199f347d19 tempest-TestStampPattern-956861796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-a59b4937-3fee-480b-8042-271f7a1a484d req-da86f2bd-e2cc-4373-a3af-cc199f347d19 tempest-TestStampPattern-956861796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-a59b4937-3fee-480b-8042-271f7a1a484d req-da86f2bd-e2cc-4373-a3af-cc199f347d19 tempest-TestStampPattern-956861796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24e0c085-f01a-4f3c-abe9-efdb8b2b72ef', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:37:06 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-a59b4937-3fee-480b-8042-271f7a1a484d req-da86f2bd-e2cc-4373-a3af-cc199f347d19 tempest-TestStampPattern-956861796 None] attachment_update completed successfully. Nov 01 12:37:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-7852986f-426e-4629-aaf4-624425969dfe req-347aed12-db0b-42f6-ba73-6e02e21b10cb tempest-TestStampPattern-956861796 None] Terminate volume connection completed successfully. Nov 01 12:37:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-7852986f-426e-4629-aaf4-624425969dfe req-347aed12-db0b-42f6-ba73-6e02e21b10cb tempest-TestStampPattern-956861796 None] Deleting attachment 24e0c085-f01a-4f3c-abe9-efdb8b2b72ef. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Acquiring lock "cinder-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Lock "cinder-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Acquiring lock "cinder-quobyte-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f6be4e-807f-4db3-9239-c60a7a2bf172]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:15 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 Nov 01 12:37:15 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:15 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" returned: 0 in 0.386s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:15 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5 Nov 01 12:37:15 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:15 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5" released by "delete_volume" :: held 0.687s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Created reservations ['11666e07-6159-49e0-bb6e-f568b9567dba', '3723cffa-7462-445d-aefd-5d49f7895c5d', '78dac9d4-7b14-4c5e-a4df-6e80aa45c681', 'e3edad7e-d987-49d7-829c-bf535876403c'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:15 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:37:15 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:16 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Deleted volume successfully. Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e6286edb-304f-44c2-8602-63fd5a19eb12 tempest-TestStampPattern-956861796 None] Lock "cinder-3059cd5d-c2cd-4eec-8bf9-c07af0615cd5-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Acquiring lock "cinder-0c3709ab-d68c-4d32-a471-b42ebfc52688-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Lock "cinder-0c3709ab-d68c-4d32-a471-b42ebfc52688-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Acquiring lock "cinder-quobyte-6be16444-14f0-4f7c-af08-9283719e5235" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-6be16444-14f0-4f7c-af08-9283719e5235" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Acquiring lock "cinder-quobyte-0c3709ab-d68c-4d32-a471-b42ebfc52688" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-0c3709ab-d68c-4d32-a471-b42ebfc52688" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Deleting offline snapshot 0c3709ab-d68c-4d32-a471-b42ebfc52688 of volume 6be16444-14f0-4f7c-af08-9283719e5235 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] snapshot_file for this snap is: volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c78376-eff2-4630-9db4-e25529cf61e2]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:16 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 Nov 01 12:37:16 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:16 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688" returned: 0 in 0.363s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6be16444-14f0-4f7c-af08-9283719e5235(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:37:17 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a64173d-3cdd-4c89-bacf-937a91c881ff]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:17 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 Nov 01 12:37:17 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:17 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235" returned: 0 in 0.573s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:17 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 Nov 01 12:37:17 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:17 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688" returned: 0 in 0.323s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:17 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688 Nov 01 12:37:17 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:18 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235.0c3709ab-d68c-4d32-a471-b42ebfc52688" returned: 0 in 0.254s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-0c3709ab-d68c-4d32-a471-b42ebfc52688" released by "_delete_snapshot" :: held 1.633s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-6be16444-14f0-4f7c-af08-9283719e5235" released by "delete_snapshot" :: held 1.659s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:18 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Created reservations ['f67bb829-49d0-4ca1-a46a-82bff8526b45', '29b7a002-6066-4cd2-91c7-312d3d8f8d99', '5eda3a51-dae1-4aed-86d1-2f62a6008604', '43486a5b-60ff-47bb-b6be-618ff596cf6f'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:18 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Delete snapshot completed successfully. Nov 01 12:37:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce346adb-cc04-4f3f-968f-a234d6f1c6e0 tempest-TestStampPattern-956861796 None] Lock "cinder-0c3709ab-d68c-4d32-a471-b42ebfc52688-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Acquiring lock "cinder-6be16444-14f0-4f7c-af08-9283719e5235-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Lock "cinder-6be16444-14f0-4f7c-af08-9283719e5235-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Acquiring lock "cinder-quobyte-6be16444-14f0-4f7c-af08-9283719e5235" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-6be16444-14f0-4f7c-af08-9283719e5235" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:24 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca381d3-a413-404d-9a23-431d71d8a4f5]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:24 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 Nov 01 12:37:24 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:24 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235" returned: 0 in 0.419s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:24 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235 Nov 01 12:37:24 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:24 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6be16444-14f0-4f7c-af08-9283719e5235" returned: 0 in 0.285s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Lock "cinder-quobyte-6be16444-14f0-4f7c-af08-9283719e5235" released by "delete_volume" :: held 0.836s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:24 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Created reservations ['f6c5f3b7-573a-42aa-b8b7-cd2d01b7733f', '789f7e49-5dbc-4c35-a6ae-134454ccc596', '9d7c259a-2e2c-4113-97a2-0f3853c50462', '9eb722fb-95c2-49a5-b36f-ea5898fa8092'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:25 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:37:25 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:25 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.284s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:25 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Deleted volume successfully. Nov 01 12:37:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-dde8c915-0718-4936-aeed-1027a6a9e4d8 tempest-TestStampPattern-956861796 None] Lock "cinder-6be16444-14f0-4f7c-af08-9283719e5235-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:35 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=46,cinder:INSERT=14,cinder:UPDATE=50,cinder:DELETE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:37:35 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=47,cinder:SELECT=38,cinder:DELETE=5,cinder:INSERT=12 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:37:35 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Flow 'volume_create_manager' (2a883b73-d510-48a5-9f26-95bf197498ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca80ed51-8d45-4d26-bb3f-74928331e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca80ed51-8d45-4d26-bb3f-74928331e37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-935368490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c20f2d2-6cd9-4108-92cb-d02ce1897789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c10ffc8be9e4e2da5978ef61234be93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:36Z,use_quota=True,user_id='4dae6fbabf31437f9f9d6b1a5d07f9f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00444e27-8ca1-48f6-bca8-523c0e5836f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00444e27-8ca1-48f6-bca8-523c0e5836f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2528ba2d-0dbe-4752-b4d6-b80558e3f5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2528ba2d-0dbe-4752-b4d6-b80558e3f5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c20f2d2-6cd9-4108-92cb-d02ce1897789', 'volume_name': 'volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335e6e6e-fda7-43e9-b968-0ed3bd729a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335e6e6e-fda7-43e9-b968-0ed3bd729a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22725ad8-3d79-41a1-83ef-0f1abdbf75d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:36 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Volume 0c20f2d2-6cd9-4108-92cb-d02ce1897789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789', 'volume_size': 1} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-935368490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c20f2d2-6cd9-4108-92cb-d02ce1897789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c10ffc8be9e4e2da5978ef61234be93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:36Z,use_quota=True,user_id='4dae6fbabf31437f9f9d6b1a5d07f9f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Creating volume 0c20f2d2-6cd9-4108-92cb-d02ce1897789 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:36 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:36 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789 1073741824 Nov 01 12:37:36 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:36 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789 1073741824" returned: 0 in 0.532s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:36 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789 Nov 01 12:37:36 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:36 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789" returned: 0 in 0.298s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22725ad8-3d79-41a1-83ef-0f1abdbf75d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60af89c4-edfb-4c1a-ab64-700fe2e576ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:36 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Volume volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789 (0c20f2d2-6cd9-4108-92cb-d02ce1897789): created successfully Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60af89c4-edfb-4c1a-ab64-700fe2e576ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Flow 'volume_create_manager' (2a883b73-d510-48a5-9f26-95bf197498ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:37 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9004a182-b7a7-473a-9292-239b552492da tempest-TestMinimumBasicScenario-59260663 None] Created volume successfully. Nov 01 12:37:37 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:37:37 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:37 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.354s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:37:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:37:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-4c9302f9-8234-4f6e-8016-96a4e52c2342 req-082a7116-423f-40f4-bad6-c5c89ed1509c tempest-TestMinimumBasicScenario-59260663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-4c9302f9-8234-4f6e-8016-96a4e52c2342 req-082a7116-423f-40f4-bad6-c5c89ed1509c tempest-TestMinimumBasicScenario-59260663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [req-4c9302f9-8234-4f6e-8016-96a4e52c2342 req-082a7116-423f-40f4-bad6-c5c89ed1509c tempest-TestMinimumBasicScenario-59260663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-4c9302f9-8234-4f6e-8016-96a4e52c2342 req-082a7116-423f-40f4-bad6-c5c89ed1509c tempest-TestMinimumBasicScenario-59260663 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066', 'name': 'volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1632e77-869c-4e00-aab1-bff74c03f559', 'enforce_multipath': True} {{(pid=86812) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:37:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-4c9302f9-8234-4f6e-8016-96a4e52c2342 req-082a7116-423f-40f4-bad6-c5c89ed1509c tempest-TestMinimumBasicScenario-59260663 None] attachment_update completed successfully. Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Flow 'volume_create_manager' (932741a6-e67c-4863-a3ee-b09da02cbeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c87ce32-1717-43aa-a55c-b8a892c660d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c87ce32-1717-43aa-a55c-b8a892c660d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1820305899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06a9352-be5b-460f-a6b1-d5d061eb609b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27295d621c4e4e43bd7e64a9386bc85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:39Z,use_quota=True,user_id='1b25a0db32c5451bb40aef97fba4bba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b40089-18e7-4f49-b3b2-6b2d3c84093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b40089-18e7-4f49-b3b2-6b2d3c84093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc1db27-f5f4-4655-b986-dedb8be85932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efc1db27-f5f4-4655-b986-dedb8be85932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c06a9352-be5b-460f-a6b1-d5d061eb609b', 'volume_name': 'volume-c06a9352-be5b-460f-a6b1-d5d061eb609b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2885ccbb-501f-4ee3-beee-a6f93c5b0962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2885ccbb-501f-4ee3-beee-a6f93c5b0962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e789a1a-ee41-47c0-96bb-b4900b625e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:39 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Volume c06a9352-be5b-460f-a6b1-d5d061eb609b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c06a9352-be5b-460f-a6b1-d5d061eb609b', 'volume_size': 1} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1820305899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c06a9352-be5b-460f-a6b1-d5d061eb609b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27295d621c4e4e43bd7e64a9386bc85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:39Z,use_quota=True,user_id='1b25a0db32c5451bb40aef97fba4bba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Creating volume c06a9352-be5b-460f-a6b1-d5d061eb609b {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:39 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:39 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b 1073741824 Nov 01 12:37:39 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Flow 'volume_create_manager' (655e8694-bbcc-452e-aa85-e1a3a696330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb11109e-9df0-40c3-9d18-c6359a6a8b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb11109e-9df0-40c3-9d18-c6359a6a8b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425284364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0992981-f439-46f9-aa8b-44fd6184cb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27295d621c4e4e43bd7e64a9386bc85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:40Z,use_quota=True,user_id='1b25a0db32c5451bb40aef97fba4bba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87517dfa-e93c-45d8-a2d8-673b51bd5538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87517dfa-e93c-45d8-a2d8-673b51bd5538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c6b677-8cd1-491d-bf7d-064d8b25c544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c6b677-8cd1-491d-bf7d-064d8b25c544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0992981-f439-46f9-aa8b-44fd6184cb33', 'volume_name': 'volume-e0992981-f439-46f9-aa8b-44fd6184cb33', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d68cf1a-e99d-4a4f-aaa2-3e679884a299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d68cf1a-e99d-4a4f-aaa2-3e679884a299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2442b673-0511-4522-8bc9-aa2472043658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:40 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Volume e0992981-f439-46f9-aa8b-44fd6184cb33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0992981-f439-46f9-aa8b-44fd6184cb33', 'volume_size': 1} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Flow 'volume_create_manager' (4e19dc2b-6305-4b8c-907c-e6c1e4683284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a227810-c120-4b79-beff-7ddcb0c6cd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a227810-c120-4b79-beff-7ddcb0c6cd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2002236412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b633398d-122d-4b49-a52a-8e2006c24aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27295d621c4e4e43bd7e64a9386bc85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:40Z,use_quota=True,user_id='1b25a0db32c5451bb40aef97fba4bba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2edbfe7a-fbc6-437b-bf23-27407a25659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2edbfe7a-fbc6-437b-bf23-27407a25659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0874caf4-351e-4452-a3c2-59ca073b5b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0874caf4-351e-4452-a3c2-59ca073b5b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b633398d-122d-4b49-a52a-8e2006c24aad', 'volume_name': 'volume-b633398d-122d-4b49-a52a-8e2006c24aad', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fe8c53-19c5-4425-a4d0-b1def0ca89b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fe8c53-19c5-4425-a4d0-b1def0ca89b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7e2748-dbea-45c0-b3f3-2a47fffb921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:40 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Volume b633398d-122d-4b49-a52a-8e2006c24aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b633398d-122d-4b49-a52a-8e2006c24aad', 'volume_size': 1} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:40 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b 1073741824" returned: 0 in 0.733s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:40 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b Nov 01 12:37:40 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:40 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b" returned: 0 in 0.404s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1425284364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0992981-f439-46f9-aa8b-44fd6184cb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27295d621c4e4e43bd7e64a9386bc85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:40Z,use_quota=True,user_id='1b25a0db32c5451bb40aef97fba4bba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Creating volume e0992981-f439-46f9-aa8b-44fd6184cb33 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:40 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:40 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33 1073741824 Nov 01 12:37:40 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e789a1a-ee41-47c0-96bb-b4900b625e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c06a9352-be5b-460f-a6b1-d5d061eb609b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c22e810-b3a9-45ee-841f-da6521067a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:40 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Flow 'volume_create_manager' (e0066973-6ce5-4057-b0dc-47ce3a25af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fe89c0-1a3c-4fb8-8bfa-9129e7edc36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Volume volume-c06a9352-be5b-460f-a6b1-d5d061eb609b (c06a9352-be5b-460f-a6b1-d5d061eb609b): created successfully Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c22e810-b3a9-45ee-841f-da6521067a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Flow 'volume_create_manager' (932741a6-e67c-4863-a3ee-b09da02cbeb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2fe89c0-1a3c-4fb8-8bfa-9129e7edc36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-69093847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1007a5ca-5738-4343-b4b9-afec3e3f07f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27295d621c4e4e43bd7e64a9386bc85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:41Z,use_quota=True,user_id='1b25a0db32c5451bb40aef97fba4bba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9009772f-936f-495b-8a87-fa63422e6ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9009772f-936f-495b-8a87-fa63422e6ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2869ac0f-d882-4477-add8-1ff9ecced050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2869ac0f-d882-4477-add8-1ff9ecced050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1007a5ca-5738-4343-b4b9-afec3e3f07f5', 'volume_name': 'volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cc5dea-58d9-407a-a6bf-2d6b8fab7911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cc5dea-58d9-407a-a6bf-2d6b8fab7911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98e35c2-6af1-4833-9dc8-9045538ddc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Volume 1007a5ca-5738-4343-b4b9-afec3e3f07f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5', 'volume_size': 1} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:41 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-38a19380-a335-435f-88d4-97b92c6d6ba3 tempest-CreateVolumesFromImageTest-1968613683 None] Created volume successfully. Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Flow 'volume_create_manager' (e2a8a95c-9457-4758-9227-abc9b7c63225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736cac4c-2009-4e29-89d1-e809f42561d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736cac4c-2009-4e29-89d1-e809f42561d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-534428445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ad9647-a3d7-4584-bbb1-cef11d50495a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27295d621c4e4e43bd7e64a9386bc85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:41Z,use_quota=True,user_id='1b25a0db32c5451bb40aef97fba4bba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6314a7af-2a13-4635-bdaf-8f4bda1bbd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6314a7af-2a13-4635-bdaf-8f4bda1bbd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b4812e-11f2-451e-bca3-433f430a92cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84b4812e-11f2-451e-bca3-433f430a92cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ad9647-a3d7-4584-bbb1-cef11d50495a', 'volume_name': 'volume-50ad9647-a3d7-4584-bbb1-cef11d50495a', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62db4d42-a448-4121-8bce-777d9f186878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62db4d42-a448-4121-8bce-777d9f186878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0185dec-feef-42bc-985b-19c34664f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Volume 50ad9647-a3d7-4584-bbb1-cef11d50495a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ad9647-a3d7-4584-bbb1-cef11d50495a', 'volume_size': 1} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:41 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33 1073741824" returned: 0 in 0.724s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:41 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33 Nov 01 12:37:41 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:41 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33" returned: 0 in 0.281s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2002236412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b633398d-122d-4b49-a52a-8e2006c24aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27295d621c4e4e43bd7e64a9386bc85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:40Z,use_quota=True,user_id='1b25a0db32c5451bb40aef97fba4bba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Creating volume b633398d-122d-4b49-a52a-8e2006c24aad {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:41 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2442b673-0511-4522-8bc9-aa2472043658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0992981-f439-46f9-aa8b-44fd6184cb33', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208e56cc-ae6e-4372-92e8-a38649634f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:41 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad 1073741824 Nov 01 12:37:41 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:42 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Volume volume-e0992981-f439-46f9-aa8b-44fd6184cb33 (e0992981-f439-46f9-aa8b-44fd6184cb33): created successfully Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208e56cc-ae6e-4372-92e8-a38649634f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Flow 'volume_create_manager' (655e8694-bbcc-452e-aa85-e1a3a696330b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-87a004db-8e20-4e50-a127-4ca15b483d45 tempest-CreateVolumesFromImageTest-1968613683 None] Created volume successfully. Nov 01 12:37:42 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad 1073741824" returned: 0 in 0.600s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:42 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad Nov 01 12:37:42 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:42 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-69093847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1007a5ca-5738-4343-b4b9-afec3e3f07f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27295d621c4e4e43bd7e64a9386bc85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:41Z,use_quota=True,user_id='1b25a0db32c5451bb40aef97fba4bba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Creating volume 1007a5ca-5738-4343-b4b9-afec3e3f07f5 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:42 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e7e2748-dbea-45c0-b3f3-2a47fffb921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b633398d-122d-4b49-a52a-8e2006c24aad', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:42 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5 1073741824 Nov 01 12:37:42 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3097f84-b6a2-4cc3-9c75-2292e5c3be90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:42 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Volume volume-b633398d-122d-4b49-a52a-8e2006c24aad (b633398d-122d-4b49-a52a-8e2006c24aad): created successfully Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3097f84-b6a2-4cc3-9c75-2292e5c3be90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Flow 'volume_create_manager' (4e19dc2b-6305-4b8c-907c-e6c1e4683284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c0405206-8eee-454c-9978-9a7ad0953ff4 tempest-CreateVolumesFromImageTest-1968613683 None] Created volume successfully. Nov 01 12:37:43 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5 1073741824" returned: 0 in 0.466s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:43 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5 Nov 01 12:37:43 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:43 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5" returned: 0 in 0.314s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.106s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-534428445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ad9647-a3d7-4584-bbb1-cef11d50495a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27295d621c4e4e43bd7e64a9386bc85f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:41Z,use_quota=True,user_id='1b25a0db32c5451bb40aef97fba4bba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Creating volume 50ad9647-a3d7-4584-bbb1-cef11d50495a {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:43 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f98e35c2-6af1-4833-9dc8-9045538ddc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0d1ea7-4375-408e-be27-b0658c40e1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:43 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a 1073741824 Nov 01 12:37:43 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:43 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Volume volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5 (1007a5ca-5738-4343-b4b9-afec3e3f07f5): created successfully Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0d1ea7-4375-408e-be27-b0658c40e1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Flow 'volume_create_manager' (e0066973-6ce5-4057-b0dc-47ce3a25af86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3e3d42eb-8f48-402d-b3a5-2c4d153dbd47 tempest-CreateVolumesFromImageTest-1968613683 None] Created volume successfully. Nov 01 12:37:44 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a 1073741824" returned: 0 in 0.567s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:44 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a Nov 01 12:37:44 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:44 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a" returned: 0 in 0.320s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0185dec-feef-42bc-985b-19c34664f172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ad9647-a3d7-4584-bbb1-cef11d50495a', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9119230d-2e67-4dc1-b437-a3d5ad6c3bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:44 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Volume volume-50ad9647-a3d7-4584-bbb1-cef11d50495a (50ad9647-a3d7-4584-bbb1-cef11d50495a): created successfully Nov 01 12:37:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9119230d-2e67-4dc1-b437-a3d5ad6c3bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Flow 'volume_create_manager' (e2a8a95c-9457-4758-9227-abc9b7c63225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:44 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-54eb33eb-70bb-4b68-a2cc-a1cc4db52ae0 tempest-CreateVolumesFromImageTest-1968613683 None] Created volume successfully. Nov 01 12:37:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "cinder-50ad9647-a3d7-4584-bbb1-cef11d50495a-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-50ad9647-a3d7-4584-bbb1-cef11d50495a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "cinder-quobyte-50ad9647-a3d7-4584-bbb1-cef11d50495a" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-quobyte-50ad9647-a3d7-4584-bbb1-cef11d50495a" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:45 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c6dfb9-a470-4a6c-9b75-40f2c8c172eb]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:45 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a Nov 01 12:37:45 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:45 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a" returned: 0 in 0.509s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:45 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a Nov 01 12:37:45 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:45 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-50ad9647-a3d7-4584-bbb1-cef11d50495a" returned: 0 in 0.298s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-quobyte-50ad9647-a3d7-4584-bbb1-cef11d50495a" released by "delete_volume" :: held 0.864s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Created reservations ['fe39ce06-0bea-4f4c-867a-68d2a1cb3581', '545352a3-fa7f-45a9-acc6-53c01f145990', '75e87520-975f-4794-992a-de44b91e51d9', '77d1e735-0bf4-40ae-9ee3-3dd07695d43b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:46 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:37:46 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "cinder-1007a5ca-5738-4343-b4b9-afec3e3f07f5-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-1007a5ca-5738-4343-b4b9-afec3e3f07f5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "cinder-quobyte-1007a5ca-5738-4343-b4b9-afec3e3f07f5" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-quobyte-1007a5ca-5738-4343-b4b9-afec3e3f07f5" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[45305543-cae5-4b35-a66d-3e8b1c7a8038]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:46 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.402s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Deleted volume successfully. Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8178eaa6-d746-43fe-8e14-a1863a78ab5f tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-50ad9647-a3d7-4584-bbb1-cef11d50495a-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:46 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5 Nov 01 12:37:46 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:46 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5" returned: 0 in 0.491s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:46 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5 Nov 01 12:37:46 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:47 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-1007a5ca-5738-4343-b4b9-afec3e3f07f5" returned: 0 in 0.279s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-quobyte-1007a5ca-5738-4343-b4b9-afec3e3f07f5" released by "delete_volume" :: held 0.834s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Created reservations ['c9ad1c7e-fce2-49e3-8e53-c51dec8a7f99', '9ee8edcb-899f-44d8-ac36-8cf6691e4beb', '7a5e9cc2-4efa-45a3-8bee-abdfff5cc57e', '8c8fda67-0311-4432-86d0-c061b06156dc'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:47 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:37:47 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "cinder-b633398d-122d-4b49-a52a-8e2006c24aad-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-b633398d-122d-4b49-a52a-8e2006c24aad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "cinder-quobyte-b633398d-122d-4b49-a52a-8e2006c24aad" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-quobyte-b633398d-122d-4b49-a52a-8e2006c24aad" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:47 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:47 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Deleted volume successfully. Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf0057f-c1d2-447d-816a-8d139a87bf8c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-90153bbf-0eb5-45c7-b9b5-c8ece0891735 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-1007a5ca-5738-4343-b4b9-afec3e3f07f5-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:47 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad Nov 01 12:37:47 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:48 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad" returned: 0 in 0.380s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:48 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad Nov 01 12:37:48 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:48 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b633398d-122d-4b49-a52a-8e2006c24aad" returned: 0 in 0.277s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-quobyte-b633398d-122d-4b49-a52a-8e2006c24aad" released by "delete_volume" :: held 0.714s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Created reservations ['93956286-7df0-4fd5-8443-6d2af21bee01', '0019f1df-087d-40d3-9e43-6887e454e280', '225909a3-e415-49ee-ac4d-0fe7608c241f', 'fd416aa0-b93f-4281-a125-00727e0f835a'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:48 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:37:48 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "cinder-e0992981-f439-46f9-aa8b-44fd6184cb33-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-e0992981-f439-46f9-aa8b-44fd6184cb33-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:48 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.279s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Deleted volume successfully. Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "cinder-quobyte-e0992981-f439-46f9-aa8b-44fd6184cb33" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-11847b87-0b55-4baa-a0c7-4492c1e512ce tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-b633398d-122d-4b49-a52a-8e2006c24aad-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-quobyte-e0992981-f439-46f9-aa8b-44fd6184cb33" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d129a3-3e8d-464c-8ae6-baf141a1d128]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:48 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33 Nov 01 12:37:48 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:49 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33" returned: 0 in 0.352s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:49 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33 Nov 01 12:37:49 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:49 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0992981-f439-46f9-aa8b-44fd6184cb33" returned: 0 in 0.239s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-quobyte-e0992981-f439-46f9-aa8b-44fd6184cb33" released by "delete_volume" :: held 0.631s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Created reservations ['4147eae8-9b72-4bcf-beb7-11a2b640c58a', '0f711bce-daa7-4807-b633-9bb807e63187', '785279f9-eb4f-4eac-b72e-58c31fc37563', '25aedc16-cbba-4ccb-bfd2-5864bcbecfbf'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:49 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:37:49 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:49 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.236s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:49 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Deleted volume successfully. Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6117c04a-991b-4efb-9fb2-f0278c4ebf56 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-e0992981-f439-46f9-aa8b-44fd6184cb33-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "cinder-c06a9352-be5b-460f-a6b1-d5d061eb609b-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-c06a9352-be5b-460f-a6b1-d5d061eb609b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "cinder-quobyte-c06a9352-be5b-460f-a6b1-d5d061eb609b" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-quobyte-c06a9352-be5b-460f-a6b1-d5d061eb609b" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71ab0d9-324c-4e0c-a91b-09552cd08d3e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:50 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b Nov 01 12:37:50 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:50 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b" returned: 0 in 0.364s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:50 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b Nov 01 12:37:50 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:50 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-c06a9352-be5b-460f-a6b1-d5d061eb609b" returned: 0 in 0.246s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-quobyte-c06a9352-be5b-460f-a6b1-d5d061eb609b" released by "delete_volume" :: held 0.652s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Created reservations ['ea711588-3e00-48dd-b089-7ec4cf4e3418', '9e5a1b33-70b1-4e60-9942-8eba4395a0d2', '92fa0f4f-7c06-490e-b230-f8b7e63668a5', '01f03422-bc4f-4509-a718-8b945dc2c15b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:50 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:37:50 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:50 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.235s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Deleted volume successfully. Nov 01 12:37:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2f654883-e784-4bb6-a8fa-c4bb22c56036 tempest-CreateVolumesFromImageTest-1968613683 None] Lock "cinder-c06a9352-be5b-460f-a6b1-d5d061eb609b-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (37b1b7a4-251a-40d8-889d-d057f5354225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5abe83-d5db-4263-83d6-b002a6a749ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5abe83-d5db-4263-83d6-b002a6a749ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528511616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8159cd-11a8-4678-b366-124bdf8db831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:54Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9e5ce9-f73a-4ee9-ad9a-e4039e30c535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9e5ce9-f73a-4ee9-ad9a-e4039e30c535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92315e0-6dac-42ab-aeae-b3ec762d181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92315e0-6dac-42ab-aeae-b3ec762d181b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f8159cd-11a8-4678-b366-124bdf8db831', 'volume_name': 'volume-7f8159cd-11a8-4678-b366-124bdf8db831', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef031a9-7a47-426b-82f2-97b3ce2b2220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef031a9-7a47-426b-82f2-97b3ce2b2220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4dddefa-6cb9-4594-a36e-c4d333162aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:54 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume 7f8159cd-11a8-4678-b366-124bdf8db831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f8159cd-11a8-4678-b366-124bdf8db831', 'volume_size': 1} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1528511616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f8159cd-11a8-4678-b366-124bdf8db831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:54Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Creating volume 7f8159cd-11a8-4678-b366-124bdf8db831 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:54 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:54 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 1073741824 Nov 01 12:37:54 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:54 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 1073741824" returned: 0 in 0.402s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:55 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 Nov 01 12:37:55 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:55 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831" returned: 0 in 0.261s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4dddefa-6cb9-4594-a36e-c4d333162aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f8159cd-11a8-4678-b366-124bdf8db831', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480bcb24-aaa1-4682-86d5-f4396367a32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:55 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume volume-7f8159cd-11a8-4678-b366-124bdf8db831 (7f8159cd-11a8-4678-b366-124bdf8db831): created successfully Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480bcb24-aaa1-4682-86d5-f4396367a32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (37b1b7a4-251a-40d8-889d-d057f5354225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:55 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5b929c84-9688-4307-9aca-a5d3adb3eb2f tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created volume successfully. Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Creating offline snapshot fe8da2fb-cfb3-464e-ad4e-49909b111983 of volume 7f8159cd-11a8-4678-b366-124bdf8db831 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c149be1b-c18d-401d-9d49-5ce24486d3ca]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:55 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 Nov 01 12:37:55 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:56 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831" returned: 0 in 0.379s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:56 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 1G Nov 01 12:37:56 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:56 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 1G" returned: 0 in 0.418s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f8159cd-11a8-4678-b366-124bdf8db831 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:56 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f8159cd-11a8-4678-b366-124bdf8db831 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 Nov 01 12:37:56 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:56 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f8159cd-11a8-4678-b366-124bdf8db831 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983" returned: 0 in 0.309s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:56 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 is being set with open permissions: ugo+rw Nov 01 12:37:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:56 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 Nov 01 12:37:56 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:57 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983" returned: 0 in 0.249s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:57 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.info Nov 01 12:37:57 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:57 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.info" returned: 0 in 0.243s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:57 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.info is being set with open permissions: ugo+rw Nov 01 12:37:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:57 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.info Nov 01 12:37:57 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:57 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.info" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:57 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e0f78d2d-34c2-4b27-ac24-781611b51836 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Create snapshot completed successfully Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (b87fba67-e241-41f0-878f-f32544dbb7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a4ce30-90a1-47ce-8b66-aa0988081976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a4ce30-90a1-47ce-8b66-aa0988081976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967935851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88c067a-3f6a-4aef-8369-709c4e38faf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:58Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049b3193-3f1e-4f87-b24c-5fe2b41ed74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049b3193-3f1e-4f87-b24c-5fe2b41ed74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1432aa46-6780-4b12-91cb-990272179926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1432aa46-6780-4b12-91cb-990272179926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88c067a-3f6a-4aef-8369-709c4e38faf9', 'volume_name': 'volume-a88c067a-3f6a-4aef-8369-709c4e38faf9', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0d643b-b731-4300-8024-458e6eb44a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f0d643b-b731-4300-8024-458e6eb44a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e46bf9-49a5-4536-893e-e8c9a09c3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume a88c067a-3f6a-4aef-8369-709c4e38faf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88c067a-3f6a-4aef-8369-709c4e38faf9', 'volume_size': 1} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967935851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88c067a-3f6a-4aef-8369-709c4e38faf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:58Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Creating volume a88c067a-3f6a-4aef-8369-709c4e38faf9 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:58 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:58 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9 1073741824 Nov 01 12:37:58 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (654732c5-c5d2-4842-902a-012b22d1bf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f1ee1a-4d34-40ff-b49e-c77297c056ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f1ee1a-4d34-40ff-b49e-c77297c056ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1694077806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7197336b-ed2d-4b44-bd19-e224ea2b7a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:59Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adc27be-b777-41e2-857c-dce1b55dc354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8adc27be-b777-41e2-857c-dce1b55dc354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cc0aba-804b-49e5-a838-36432cde9564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17cc0aba-804b-49e5-a838-36432cde9564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7197336b-ed2d-4b44-bd19-e224ea2b7a55', 'volume_name': 'volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c6079a-a376-4dc3-b248-c0f9a6e77dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c6079a-a376-4dc3-b248-c0f9a6e77dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d46189-4636-49bf-b0f3-295fb26dd43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume 7197336b-ed2d-4b44-bd19-e224ea2b7a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55', 'volume_size': 1} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:58 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9 1073741824" returned: 0 in 0.532s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:59 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9 Nov 01 12:37:59 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (ba37d48b-e48b-4423-99df-d0165455754c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be7788b-7a8f-41e9-84b2-7a5d4f71ef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9" returned: 0 in 0.353s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1694077806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7197336b-ed2d-4b44-bd19-e224ea2b7a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:59Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Creating volume 7197336b-ed2d-4b44-bd19-e224ea2b7a55 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:59 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:59 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55 1073741824 Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be7788b-7a8f-41e9-84b2-7a5d4f71ef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1652593752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93116b45-8513-4cd3-891c-ad4968a12ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:59Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f892918-0260-41aa-a7d5-b05c896379e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f892918-0260-41aa-a7d5-b05c896379e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51941d69-5930-4fc7-93f5-e22c25a2823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51941d69-5930-4fc7-93f5-e22c25a2823f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93116b45-8513-4cd3-891c-ad4968a12ff6', 'volume_name': 'volume-93116b45-8513-4cd3-891c-ad4968a12ff6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1494895b-1eb1-49a3-a0dc-9f5a59f441a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1494895b-1eb1-49a3-a0dc-9f5a59f441a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866cca81-f4f0-4f74-9cd1-5c523b9c9919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume 93116b45-8513-4cd3-891c-ad4968a12ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93116b45-8513-4cd3-891c-ad4968a12ff6', 'volume_size': 1} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e46bf9-49a5-4536-893e-e8c9a09c3759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88c067a-3f6a-4aef-8369-709c4e38faf9', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c528169-4ca6-479b-8ad9-29611c44e643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume volume-a88c067a-3f6a-4aef-8369-709c4e38faf9 (a88c067a-3f6a-4aef-8369-709c4e38faf9): created successfully Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c528169-4ca6-479b-8ad9-29611c44e643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (b87fba67-e241-41f0-878f-f32544dbb7ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:59 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e2f956cf-2508-4f60-900d-bb34135c1f11 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created volume successfully. Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (bf502811-764e-4e46-8e52-505c67133d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7c57c6-2d9a-4612-b732-631290099886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7c57c6-2d9a-4612-b732-631290099886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1685271077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5c05df-052c-4d41-8e32-d8eabd74cd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:00Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7165f98-dc21-4d1d-bc16-8c22e8946f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7165f98-dc21-4d1d-bc16-8c22e8946f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0473a6-0ebc-4c3b-8774-a20f6a5af438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0473a6-0ebc-4c3b-8774-a20f6a5af438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d5c05df-052c-4d41-8e32-d8eabd74cd53', 'volume_name': 'volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4480db9d-1dfd-4677-8960-90c92b89f7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4480db9d-1dfd-4677-8960-90c92b89f7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dccbfc0-5b8c-43c4-9f7c-367a2ba8b056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume 3d5c05df-052c-4d41-8e32-d8eabd74cd53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53', 'volume_size': 1} Nov 01 12:37:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:00 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55 1073741824" returned: 0 in 0.717s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:00 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55 Nov 01 12:38:00 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (bf4f4367-46c9-4b5f-af27-79ab0dba0c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3578e4b9-2a8e-424a-9864-12be7a4b9625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3578e4b9-2a8e-424a-9864-12be7a4b9625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1434441271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbe973f-da1c-4544-9be9-5952a0e5082a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:00Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ce1ec1-65db-4ffa-ac55-b1e692a19228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ce1ec1-65db-4ffa-ac55-b1e692a19228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90a854c-b2ab-4123-8b31-b47c3a3093bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c90a854c-b2ab-4123-8b31-b47c3a3093bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfbe973f-da1c-4544-9be9-5952a0e5082a', 'volume_name': 'volume-dfbe973f-da1c-4544-9be9-5952a0e5082a', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7465a56-1a73-4a01-ab10-36fc33477902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7465a56-1a73-4a01-ab10-36fc33477902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d78f934-d0a4-4cf1-8055-2b6457c7e387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:00 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume dfbe973f-da1c-4544-9be9-5952a0e5082a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfbe973f-da1c-4544-9be9-5952a0e5082a', 'volume_size': 1} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:00 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55" returned: 0 in 0.288s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.935s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1652593752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93116b45-8513-4cd3-891c-ad4968a12ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:59Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Creating volume 93116b45-8513-4cd3-891c-ad4968a12ff6 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:00 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d46189-4636-49bf-b0f3-295fb26dd43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed3832e-0caf-42ed-871f-88ad57a0c580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:00 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6 1073741824 Nov 01 12:38:00 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:00 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55 (7197336b-ed2d-4b44-bd19-e224ea2b7a55): created successfully Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed3832e-0caf-42ed-871f-88ad57a0c580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (654732c5-c5d2-4842-902a-012b22d1bf60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:00 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-87fc7e24-2a57-468e-9c52-9d46d4f644fd tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created volume successfully. Nov 01 12:38:00 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6 1073741824" returned: 0 in 0.563s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:01 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6 Nov 01 12:38:01 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:01 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.366s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1685271077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d5c05df-052c-4d41-8e32-d8eabd74cd53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:00Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Creating volume 3d5c05df-052c-4d41-8e32-d8eabd74cd53 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:01 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:01 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53 1073741824 Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866cca81-f4f0-4f74-9cd1-5c523b9c9919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93116b45-8513-4cd3-891c-ad4968a12ff6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:01 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c038d61d-ce21-4399-958b-d9696c94136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:01 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume volume-93116b45-8513-4cd3-891c-ad4968a12ff6 (93116b45-8513-4cd3-891c-ad4968a12ff6): created successfully Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c038d61d-ce21-4399-958b-d9696c94136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (ba37d48b-e48b-4423-99df-d0165455754c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:01 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9a9908dc-aeb8-4e14-accb-834c5b17117b tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created volume successfully. Nov 01 12:38:01 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53 1073741824" returned: 0 in 0.427s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:01 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53 Nov 01 12:38:01 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:02 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53" returned: 0 in 0.275s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.671s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1434441271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfbe973f-da1c-4544-9be9-5952a0e5082a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40aa42d669d44a6fb91301dcf20e4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:00Z,use_quota=True,user_id='977f1155a21f4ad8a670c7ceff42fcec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Creating volume dfbe973f-da1c-4544-9be9-5952a0e5082a {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:02 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:02 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a 1073741824 Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dccbfc0-5b8c-43c4-9f7c-367a2ba8b056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:02 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c42bc4-27c1-45b6-b923-18213868199d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:02 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53 (3d5c05df-052c-4d41-8e32-d8eabd74cd53): created successfully Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c42bc4-27c1-45b6-b923-18213868199d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (bf502811-764e-4e46-8e52-505c67133d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:02 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c39d072e-42f2-4026-99d9-7f00c61115fa tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created volume successfully. Nov 01 12:38:02 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a 1073741824" returned: 0 in 0.511s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:02 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a Nov 01 12:38:02 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:02 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a" returned: 0 in 0.262s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d78f934-d0a4-4cf1-8055-2b6457c7e387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfbe973f-da1c-4544-9be9-5952a0e5082a', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a524c5f-aadd-4511-8ac6-397a8bdbc853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:02 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Volume volume-dfbe973f-da1c-4544-9be9-5952a0e5082a (dfbe973f-da1c-4544-9be9-5952a0e5082a): created successfully Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a524c5f-aadd-4511-8ac6-397a8bdbc853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:02 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Flow 'volume_create_manager' (bf4f4367-46c9-4b5f-af27-79ab0dba0c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:02 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9b3113a0-57be-4da5-ad6a-3ceaf49072a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created volume successfully. Nov 01 12:38:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-dfbe973f-da1c-4544-9be9-5952a0e5082a-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-dfbe973f-da1c-4544-9be9-5952a0e5082a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-quobyte-dfbe973f-da1c-4544-9be9-5952a0e5082a" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-dfbe973f-da1c-4544-9be9-5952a0e5082a" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:03 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b93938-fb13-4eda-b6c3-2c33b0052dfd]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:03 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a Nov 01 12:38:03 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:04 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a" returned: 0 in 0.368s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:04 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a Nov 01 12:38:04 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:04 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dfbe973f-da1c-4544-9be9-5952a0e5082a" returned: 0 in 0.248s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-dfbe973f-da1c-4544-9be9-5952a0e5082a" released by "delete_volume" :: held 0.666s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created reservations ['bc1e7e0c-51b2-479e-a594-5c06df4ebb61', '103d4344-3e0b-434c-a052-1e71da93359c', '3f1b3a88-fae1-4bde-a899-b7803e475f68', 'e0f196c4-f2f1-4a8a-8414-2efc28f47e68'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:04 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:04 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:04 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:04 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Deleted volume successfully. Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-3d5c05df-052c-4d41-8e32-d8eabd74cd53-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-db86250f-38d5-4b97-a775-f344dcfadbf5 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-dfbe973f-da1c-4544-9be9-5952a0e5082a-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-3d5c05df-052c-4d41-8e32-d8eabd74cd53-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-quobyte-3d5c05df-052c-4d41-8e32-d8eabd74cd53" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-3d5c05df-052c-4d41-8e32-d8eabd74cd53" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca37614-1a11-4f2e-b6ca-11df6d9947b7]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:05 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53 Nov 01 12:38:05 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:05 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53" returned: 0 in 0.356s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:05 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53 Nov 01 12:38:05 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:05 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d5c05df-052c-4d41-8e32-d8eabd74cd53" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-3d5c05df-052c-4d41-8e32-d8eabd74cd53" released by "delete_volume" :: held 0.657s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created reservations ['27ffc3ef-7692-41e2-a8ed-a6e2c272a6e1', '8d502607-36ca-47cf-9d7d-c8b34e2ffc48', '984df6f9-d25c-430b-a2ab-dad3766bff19', 'f9457c5d-fd94-4886-a66a-93f3ba428889'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:05 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:05 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:06 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.268s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-93116b45-8513-4cd3-891c-ad4968a12ff6-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:06 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Deleted volume successfully. Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6ca999d4-fdbf-4434-8fc6-3e4e46ed8e90 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-3d5c05df-052c-4d41-8e32-d8eabd74cd53-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-93116b45-8513-4cd3-891c-ad4968a12ff6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-quobyte-93116b45-8513-4cd3-891c-ad4968a12ff6" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-93116b45-8513-4cd3-891c-ad4968a12ff6" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e8ee2-9dbc-4b51-978f-3ac948c3830b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:06 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6 Nov 01 12:38:06 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:06 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6" returned: 0 in 0.376s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:06 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6 Nov 01 12:38:06 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:06 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-93116b45-8513-4cd3-891c-ad4968a12ff6" returned: 0 in 0.246s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-93116b45-8513-4cd3-891c-ad4968a12ff6" released by "delete_volume" :: held 0.660s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created reservations ['cf72f19b-6c1e-4e74-b420-5cf02e9c7a78', '55aef518-76d4-4733-9308-d5edcd1d792d', '6f3e9558-aed6-4e9e-887f-ebe102dae732', 'e8302ebd-7467-4b87-bd0d-ea09024555b5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:06 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:06 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:07 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.257s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:07 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Deleted volume successfully. Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e2dc5174-cb9c-4958-9616-3b584b7962a3 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-93116b45-8513-4cd3-891c-ad4968a12ff6-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-7197336b-ed2d-4b44-bd19-e224ea2b7a55-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-7197336b-ed2d-4b44-bd19-e224ea2b7a55-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-quobyte-7197336b-ed2d-4b44-bd19-e224ea2b7a55" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-7197336b-ed2d-4b44-bd19-e224ea2b7a55" acquired by "delete_volume" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb06e990-795d-4e8f-844c-2cdf6a02b9e5]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:07 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55 Nov 01 12:38:07 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:07 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55" returned: 0 in 0.366s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:07 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55 Nov 01 12:38:07 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:07 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7197336b-ed2d-4b44-bd19-e224ea2b7a55" returned: 0 in 0.245s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-7197336b-ed2d-4b44-bd19-e224ea2b7a55" released by "delete_volume" :: held 0.656s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:07 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created reservations ['26d049e4-20a8-44c0-88cd-2ac1c1adcc34', '8a41db2d-46ab-4de0-be09-f3c88238c065', '90240d7d-aa71-4025-aa64-bdc1f4015e4b', 'eccf68ab-411b-4129-96cd-7e5621aae4fa'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:08 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:08 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:08 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.262s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:08 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Deleted volume successfully. Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13dc3e93-de14-4799-a2f5-222b017554fb tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-7197336b-ed2d-4b44-bd19-e224ea2b7a55-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-a88c067a-3f6a-4aef-8369-709c4e38faf9-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-a88c067a-3f6a-4aef-8369-709c4e38faf9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-quobyte-a88c067a-3f6a-4aef-8369-709c4e38faf9" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-a88c067a-3f6a-4aef-8369-709c4e38faf9" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe78711-15a4-4aef-a3c2-8155a83c142b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:08 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9 Nov 01 12:38:08 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:08 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9" returned: 0 in 0.365s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:08 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9 Nov 01 12:38:08 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:09 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a88c067a-3f6a-4aef-8369-709c4e38faf9" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-a88c067a-3f6a-4aef-8369-709c4e38faf9" released by "delete_volume" :: held 0.667s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created reservations ['b19ce68c-4156-4725-a2ec-5f8bb6b7b55f', '7ff01180-52a8-476e-a339-5129d64c788b', '0fc4a509-8411-4ee8-9b72-be95f9f28e21', '3dc9c29c-6510-4923-bc46-d70132e497b5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:09 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:09 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:09 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.281s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Deleted volume successfully. Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4899a4f5-c8fe-4b90-b223-2eb0e77a3e50 tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-a88c067a-3f6a-4aef-8369-709c4e38faf9-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-fe8da2fb-cfb3-464e-ad4e-49909b111983-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-fe8da2fb-cfb3-464e-ad4e-49909b111983-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-quobyte-7f8159cd-11a8-4678-b366-124bdf8db831" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-7f8159cd-11a8-4678-b366-124bdf8db831" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-quobyte-fe8da2fb-cfb3-464e-ad4e-49909b111983" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-fe8da2fb-cfb3-464e-ad4e-49909b111983" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Deleting offline snapshot fe8da2fb-cfb3-464e-ad4e-49909b111983 of volume 7f8159cd-11a8-4678-b366-124bdf8db831 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] snapshot_file for this snap is: volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bdd2b8-de29-4321-9942-e4cb905d60fe]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:09 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 Nov 01 12:38:09 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:10 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983" returned: 0 in 0.356s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f8159cd-11a8-4678-b366-124bdf8db831(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:38:10 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[da70d8e4-563b-43ac-8684-34f7edf1367e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:10 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 Nov 01 12:38:10 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:10 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831" returned: 0 in 0.352s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:10 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 Nov 01 12:38:10 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:10 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983" returned: 0 in 0.348s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:10 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983 Nov 01 12:38:10 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:11 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831.fe8da2fb-cfb3-464e-ad4e-49909b111983" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-fe8da2fb-cfb3-464e-ad4e-49909b111983" released by "_delete_snapshot" :: held 1.425s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-7f8159cd-11a8-4678-b366-124bdf8db831" released by "delete_snapshot" :: held 1.454s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created reservations ['3e0fe2f5-fac3-4ea9-909d-af5067f1d14d', '46ecc309-f24a-49a4-896a-dacecf91fc4c', 'c81fdce3-1ad0-4ef7-8696-ab69f016db03', '1f08c00b-ad4a-4a56-b78f-d38fa4433c2b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Delete snapshot completed successfully. Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34b438b0-cdd5-4950-a003-d325b8cf55ef tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-fe8da2fb-cfb3-464e-ad4e-49909b111983-delete_snapshot" released by "delete_snapshot" :: held 1.590s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-7f8159cd-11a8-4678-b366-124bdf8db831-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-7f8159cd-11a8-4678-b366-124bdf8db831-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "cinder-quobyte-7f8159cd-11a8-4678-b366-124bdf8db831" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-7f8159cd-11a8-4678-b366-124bdf8db831" acquired by "delete_volume" :: waited 0.029s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a988947-36d2-4a97-a817-aee6aa2f4d32]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:12 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 Nov 01 12:38:12 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:12 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831" returned: 0 in 0.373s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:12 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831 Nov 01 12:38:12 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:12 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7f8159cd-11a8-4678-b366-124bdf8db831" returned: 0 in 0.248s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-quobyte-7f8159cd-11a8-4678-b366-124bdf8db831" released by "delete_volume" :: held 0.683s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Created reservations ['b1ed47a9-3802-439d-a9fa-3309051217f2', '3242913b-285d-4ea3-956c-5e451e1ca28a', '42c0eecd-0ca3-41c5-ba84-be6f60b3edca', '0c59382d-891e-43e8-bb02-d9d7a48f3af8'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:12 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:12 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:12 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.266s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:12 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Deleted volume successfully. Nov 01 12:38:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-09f4a3e4-24d5-4beb-b48b-a0055ca2a2bf tempest-CreateVolumesFromSnapshotTest-1647815822 None] Lock "cinder-7f8159cd-11a8-4678-b366-124bdf8db831-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:17 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Flow 'volume_create_manager' (43797fe3-93b7-4c6a-8f31-0a7f204e72ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6490adf-c3b3-4a53-b2e8-d5a6f41b856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6490adf-c3b3-4a53-b2e8-d5a6f41b856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b13869-0792-4648-932c-bae9e6868ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5103c163829492eb87b9615a1a4a9b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:18Z,use_quota=True,user_id='355d516f3d474ec59b4860fd67925e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9dc828f-2dcf-40a3-b013-f9a214bd8da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9dc828f-2dcf-40a3-b013-f9a214bd8da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c452e7-22ac-442c-b928-37256143c335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:17 devstack cinder-volume[86812]: DEBUG cinder.image.glance [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Creating Keystone auth plugin from conf {{(pid=86812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c452e7-22ac-442c-b928-37256143c335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83b13869-0792-4648-932c-bae9e6868ec1', 'volume_name': 'volume-83b13869-0792-4648-932c-bae9e6868ec1', 'volume_size': 1, 'image_id': 'f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff52babfbb8adbe8522f44edd49d2fe6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5103c163829492eb87b9615a1a4a9b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec1a92c62f32b293d470792d0923e63d92951de4da22dcf613bd3a8510b1e48f6c1ec740ee9a59a7974abc616bcfaf5c293dbaec3054817f5264c039d1258e8e', 'id': 'f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'created_at': datetime.datetime(2026, 11, 1, 11, 38, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 38, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8c48f21-d2bd-4aab-8bc9-3d5f500916fa/file', 'properties': {}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bd15b4-a5c5-4043-a591-e2845c50d983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bd15b4-a5c5-4043-a591-e2845c50d983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467a0357-8c0d-4aed-9dc7-89f0181f743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:18 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Volume 83b13869-0792-4648-932c-bae9e6868ec1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83b13869-0792-4648-932c-bae9e6868ec1', 'volume_size': 1, 'image_id': 'f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff52babfbb8adbe8522f44edd49d2fe6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5103c163829492eb87b9615a1a4a9b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec1a92c62f32b293d470792d0923e63d92951de4da22dcf613bd3a8510b1e48f6c1ec740ee9a59a7974abc616bcfaf5c293dbaec3054817f5264c039d1258e8e', 'id': 'f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'created_at': datetime.datetime(2026, 11, 1, 11, 38, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 38, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8c48f21-d2bd-4aab-8bc9-3d5f500916fa/file', 'properties': {}}, 'image_service': } Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Trying to clone 83b13869-0792-4648-932c-bae9e6868ec1 from image f8c48f21-d2bd-4aab-8bc9-3d5f500916fa at location (None, [{'url': 'file:///opt/stack/data/glance/images/f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'metadata': {}}]). {{(pid=86812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:38:18 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Image download 0.00 MB at 0.00 MB/s Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c91cf4-5f4a-4796-af83-c958c2bbb721]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:18 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD Nov 01 12:38:18 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:18 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:18 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD Nov 01 12:38:18 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:18 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Temporary image f8c48f21-d2bd-4aab-8bc9-3d5f500916fa is fetched for user 355d516f3d474ec59b4860fd67925e14. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae40d8b-8a4d-4e37-ae17-1c0df98f31d0]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:19 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD Nov 01 12:38:19 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:19 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:19 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD Nov 01 12:38:19 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:19 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b13869-0792-4648-932c-bae9e6868ec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5103c163829492eb87b9615a1a4a9b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:18Z,use_quota=True,user_id='355d516f3d474ec59b4860fd67925e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Creating volume 83b13869-0792-4648-932c-bae9e6868ec1 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:19 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:19 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 1073741824 Nov 01 12:38:19 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:20 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 1073741824" returned: 0 in 0.482s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:20 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 Nov 01 12:38:20 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:20 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:20 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Attempting download of f8c48f21-d2bd-4aab-8bc9-3d5f500916fa ((None, [{'url': 'file:///opt/stack/data/glance/images/f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'metadata': {}}])) to volume 83b13869-0792-4648-932c-bae9e6868ec1. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:38:20 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b7c456-e85b-4628-811b-705f6eab1785]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_yjhw74lt {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:20 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_yjhw74lt Nov 01 12:38:20 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:20 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_yjhw74lt" returned: 0 in 0.327s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_yjhw74lt {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:21 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_yjhw74lt Nov 01 12:38:21 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:21 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_yjhw74lt" returned: 1 in 0.313s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_yjhw74lt' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:38:21 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5463a1f-fca2-40c5-b18a-9980e8f589cc]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:21 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD Nov 01 12:38:21 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:21 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:21 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD Nov 01 12:38:21 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:21 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:38:21 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] f8c48f21-d2bd-4aab-8bc9-3d5f500916fa was raw, converting to qcow2 {{(pid=86812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:38:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:21 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 Nov 01 12:38:21 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:22 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1" returned: 0 in 0.452s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f8c48f21-d2bd-4aab-8bc9-3d5f500916fa_kck77mwjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:38:22 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:22 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 1G Nov 01 12:38:22 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:22 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 1G" returned: 0 in 0.325s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Downloaded image f8c48f21-d2bd-4aab-8bc9-3d5f500916fa ((None, [{'url': 'file:///opt/stack/data/glance/images/f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'metadata': {}}])) to volume 83b13869-0792-4648-932c-bae9e6868ec1 successfully. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Temporary image f8c48f21-d2bd-4aab-8bc9-3d5f500916fa for user 355d516f3d474ec59b4860fd67925e14 is deleted. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Marking volume 83b13869-0792-4648-932c-bae9e6868ec1 as bootable. {{(pid=86812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Copying metadata from image f8c48f21-d2bd-4aab-8bc9-3d5f500916fa to 83b13869-0792-4648-932c-bae9e6868ec1. {{(pid=86812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Creating volume glance metadata for volume 83b13869-0792-4648-932c-bae9e6868ec1 backed by image f8c48f21-d2bd-4aab-8bc9-3d5f500916fa with: {'image_id': 'f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ff52babfbb8adbe8522f44edd49d2fe6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (467a0357-8c0d-4aed-9dc7-89f0181f743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b13869-0792-4648-932c-bae9e6868ec1', 'volume_size': 1, 'image_id': 'f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff52babfbb8adbe8522f44edd49d2fe6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b5103c163829492eb87b9615a1a4a9b3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec1a92c62f32b293d470792d0923e63d92951de4da22dcf613bd3a8510b1e48f6c1ec740ee9a59a7974abc616bcfaf5c293dbaec3054817f5264c039d1258e8e', 'id': 'f8c48f21-d2bd-4aab-8bc9-3d5f500916fa', 'created_at': datetime.datetime(2026, 11, 1, 11, 38, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 38, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f8c48f21-d2bd-4aab-8bc9-3d5f500916fa/file', 'properties': {}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a76783f-b344-4c06-8ac8-9f23e6d35cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:22 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Volume volume-83b13869-0792-4648-932c-bae9e6868ec1 (83b13869-0792-4648-932c-bae9e6868ec1): created successfully Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a76783f-b344-4c06-8ac8-9f23e6d35cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Flow 'volume_create_manager' (43797fe3-93b7-4c6a-8f31-0a7f204e72ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a16cde92-fd9b-4e53-a261-4b2507bb3788 tempest-VolumeImageDependencyTests-751295056 None] Created volume successfully. Nov 01 12:38:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Acquiring lock "cinder-83b13869-0792-4648-932c-bae9e6868ec1-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Lock "cinder-83b13869-0792-4648-932c-bae9e6868ec1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Acquiring lock "cinder-quobyte-83b13869-0792-4648-932c-bae9e6868ec1" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Lock "cinder-quobyte-83b13869-0792-4648-932c-bae9e6868ec1" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:23 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3504907a-2565-450f-8b98-1a72195bc61c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:23 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 Nov 01 12:38:23 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:23 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1" returned: 0 in 0.416s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:23 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1 Nov 01 12:38:23 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:24 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-83b13869-0792-4648-932c-bae9e6868ec1" returned: 0 in 0.297s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Lock "cinder-quobyte-83b13869-0792-4648-932c-bae9e6868ec1" released by "delete_volume" :: held 0.772s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Created reservations ['0a4f8097-a1e1-410e-81ae-e303420635c6', '1d5a5f01-108e-4044-b26a-42bdd00699a2', '84376158-3a95-4d60-9940-0b43ae5a9742', '04f474b7-fa96-4b66-b926-83238639b0e4'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:24 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:24 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:24 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.356s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:24 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Deleted volume successfully. Nov 01 12:38:24 devstack cinder-volume[86812]: INFO cinder.volume.manager [req-2da02a15-df82-4d42-a054-b983b3c949b3 req-e535c7d1-a199-4707-83d1-44db2a4ba1d5 tempest-TestMinimumBasicScenario-59260663 None] Terminate volume connection completed successfully. Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [req-2da02a15-df82-4d42-a054-b983b3c949b3 req-e535c7d1-a199-4707-83d1-44db2a4ba1d5 tempest-TestMinimumBasicScenario-59260663 None] Deleting attachment d1632e77-869c-4e00-aab1-bff74c03f559. {{(pid=86812) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:38:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-81fd7b02-4e3d-493f-9899-752e57e231f4 tempest-VolumeImageDependencyTests-751295056 None] Lock "cinder-83b13869-0792-4648-932c-bae9e6868ec1-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Acquiring lock "cinder-0c20f2d2-6cd9-4108-92cb-d02ce1897789-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Lock "cinder-0c20f2d2-6cd9-4108-92cb-d02ce1897789-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Acquiring lock "cinder-quobyte-0c20f2d2-6cd9-4108-92cb-d02ce1897789" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Lock "cinder-quobyte-0c20f2d2-6cd9-4108-92cb-d02ce1897789" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:25 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8363e0f8-7018-4280-a84b-39ff24d00423]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:25 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789 Nov 01 12:38:25 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:25 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789" returned: 0 in 0.392s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:25 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789 Nov 01 12:38:25 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:26 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0c20f2d2-6cd9-4108-92cb-d02ce1897789" returned: 0 in 0.270s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Lock "cinder-quobyte-0c20f2d2-6cd9-4108-92cb-d02ce1897789" released by "delete_volume" :: held 0.718s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Created reservations ['907086a5-bca4-485d-a888-796c6798f8f9', '43cc2793-16ae-4b02-9a0f-c0a1314fa035', '952fb087-62bc-4c85-9888-64757e4ee7cb', 'dfa34818-3e2b-4c98-b34b-e5b988fd5638'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:26 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:26 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:26 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:26 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Deleted volume successfully. Nov 01 12:38:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1a53c75e-45ec-4258-8399-560234172c3a tempest-TestMinimumBasicScenario-59260663 None] Lock "cinder-0c20f2d2-6cd9-4108-92cb-d02ce1897789-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Flow 'volume_create_manager' (a3790c2e-1562-4bfd-bab0-07d58362c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5a75fa-dfc5-4289-8903-cfc063b7424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5a75fa-dfc5-4289-8903-cfc063b7424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8bf55f-a1ce-444b-8182-6cdb08582734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c344521509d46e9a11ff824056ede4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:28Z,use_quota=True,user_id='b328791b62a549cd8b790a2510da8de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfab14ed-05f6-40dc-b855-617efc0940ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfab14ed-05f6-40dc-b855-617efc0940ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccc4784-6e93-47f3-b8c8-5da4381eb99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bccc4784-6e93-47f3-b8c8-5da4381eb99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8bf55f-a1ce-444b-8182-6cdb08582734', 'volume_name': 'volume-4d8bf55f-a1ce-444b-8182-6cdb08582734', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5913b97-830e-479a-9beb-39426a2fbbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5913b97-830e-479a-9beb-39426a2fbbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7659773-dc4c-4ca8-8bc4-7261056fe85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:27 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Volume 4d8bf55f-a1ce-444b-8182-6cdb08582734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8bf55f-a1ce-444b-8182-6cdb08582734', 'volume_size': 1} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8bf55f-a1ce-444b-8182-6cdb08582734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c344521509d46e9a11ff824056ede4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:28Z,use_quota=True,user_id='b328791b62a549cd8b790a2510da8de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Creating volume 4d8bf55f-a1ce-444b-8182-6cdb08582734 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:27 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:27 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734 1073741824 Nov 01 12:38:27 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:28 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734 1073741824" returned: 0 in 0.513s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:28 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734 Nov 01 12:38:28 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:28 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734" returned: 0 in 0.287s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7659773-dc4c-4ca8-8bc4-7261056fe85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8bf55f-a1ce-444b-8182-6cdb08582734', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f9a30b-76ca-4d8d-86a9-ed0ca47ef5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Volume volume-4d8bf55f-a1ce-444b-8182-6cdb08582734 (4d8bf55f-a1ce-444b-8182-6cdb08582734): created successfully Nov 01 12:38:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f9a30b-76ca-4d8d-86a9-ed0ca47ef5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Flow 'volume_create_manager' (a3790c2e-1562-4bfd-bab0-07d58362c926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-48617042-ab1a-4c35-b938-f337e6597ca9 tempest-CinderUnicodeTest-1590953102 None] Created volume successfully. Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Flow 'volume_create_manager' (8a6b960d-f8a6-459f-aa7b-6534da25f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff810ec8-0b03-4150-aa96-87b928263087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff810ec8-0b03-4150-aa96-87b928263087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-861955256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf12652-af0e-4172-a5d1-692d1b972fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c344521509d46e9a11ff824056ede4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:30Z,use_quota=True,user_id='b328791b62a549cd8b790a2510da8de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7e205f-c4e8-4232-a09c-8e4ec92726fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7e205f-c4e8-4232-a09c-8e4ec92726fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac21b885-32c1-4be2-bf06-8871bbbc58f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac21b885-32c1-4be2-bf06-8871bbbc58f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf12652-af0e-4172-a5d1-692d1b972fea', 'volume_name': 'volume-6cf12652-af0e-4172-a5d1-692d1b972fea', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bc57cf-7a3e-4f70-a88b-1fcd24d13e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bc57cf-7a3e-4f70-a88b-1fcd24d13e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e11d5b-424c-45e7-80a6-ef7071357ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Volume 6cf12652-af0e-4172-a5d1-692d1b972fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf12652-af0e-4172-a5d1-692d1b972fea', 'volume_size': 1} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-861955256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf12652-af0e-4172-a5d1-692d1b972fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c344521509d46e9a11ff824056ede4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:30Z,use_quota=True,user_id='b328791b62a549cd8b790a2510da8de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Creating volume 6cf12652-af0e-4172-a5d1-692d1b972fea {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:30 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:30 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea 1073741824 Nov 01 12:38:30 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:30 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea 1073741824" returned: 0 in 0.458s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:31 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea Nov 01 12:38:31 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:31 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea" returned: 0 in 0.260s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e11d5b-424c-45e7-80a6-ef7071357ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf12652-af0e-4172-a5d1-692d1b972fea', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab55708-4bec-4fbe-a3fc-22ee19608578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:31 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Volume volume-6cf12652-af0e-4172-a5d1-692d1b972fea (6cf12652-af0e-4172-a5d1-692d1b972fea): created successfully Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab55708-4bec-4fbe-a3fc-22ee19608578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Flow 'volume_create_manager' (8a6b960d-f8a6-459f-aa7b-6534da25f882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:31 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3771504a-a83d-4c60-9d27-c62072e76048 tempest-CinderUnicodeTest-1590953102 None] Created volume successfully. Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Creating offline snapshot b1505ea2-3071-4070-ad58-35155bbcfd5c of volume 6cf12652-af0e-4172-a5d1-692d1b972fea {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2193e329-773f-46eb-9bcf-e8f441633005]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:31 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea Nov 01 12:38:31 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:32 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea" returned: 0 in 0.393s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:32 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c 1G Nov 01 12:38:32 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:32 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c 1G" returned: 0 in 0.370s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cf12652-af0e-4172-a5d1-692d1b972fea -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:32 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cf12652-af0e-4172-a5d1-692d1b972fea -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c Nov 01 12:38:32 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:32 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cf12652-af0e-4172-a5d1-692d1b972fea -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c" returned: 0 in 0.347s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:32 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c is being set with open permissions: ugo+rw Nov 01 12:38:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:32 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c Nov 01 12:38:32 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:33 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:33 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.info Nov 01 12:38:33 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:33 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.info" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:33 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.info is being set with open permissions: ugo+rw Nov 01 12:38:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:33 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.info Nov 01 12:38:33 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:33 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.info" returned: 0 in 0.292s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:33 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9aaeb653-5ebc-47c4-b2e1-58b083c0e803 tempest-CinderUnicodeTest-1590953102 None] Create snapshot completed successfully Nov 01 12:38:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "cinder-b1505ea2-3071-4070-ad58-35155bbcfd5c-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-b1505ea2-3071-4070-ad58-35155bbcfd5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "cinder-quobyte-6cf12652-af0e-4172-a5d1-692d1b972fea" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-quobyte-6cf12652-af0e-4172-a5d1-692d1b972fea" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "cinder-quobyte-b1505ea2-3071-4070-ad58-35155bbcfd5c" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-quobyte-b1505ea2-3071-4070-ad58-35155bbcfd5c" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Deleting offline snapshot b1505ea2-3071-4070-ad58-35155bbcfd5c of volume 6cf12652-af0e-4172-a5d1-692d1b972fea {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:38:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] snapshot_file for this snap is: volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:38:35 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c38bd9-7124-4c5f-8f01-c7af5e3b428b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:35 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c Nov 01 12:38:35 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:35 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c" returned: 0 in 0.348s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cf12652-af0e-4172-a5d1-692d1b972fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:38:35 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8efb4c-6a9e-43d5-a69e-7b1b8f1fb66b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:35 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea Nov 01 12:38:35 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:35 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea" returned: 0 in 0.358s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:35 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c Nov 01 12:38:35 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:36 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c" returned: 0 in 0.359s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:36 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c Nov 01 12:38:36 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:36 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea.b1505ea2-3071-4070-ad58-35155bbcfd5c" returned: 0 in 0.234s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=129,cinder:INSERT=39,cinder:UPDATE=150,cinder:DELETE=15 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=171,cinder:DELETE=15,cinder:SELECT=114,cinder:INSERT=43 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-quobyte-b1505ea2-3071-4070-ad58-35155bbcfd5c" released by "_delete_snapshot" :: held 1.440s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-quobyte-6cf12652-af0e-4172-a5d1-692d1b972fea" released by "delete_snapshot" :: held 1.490s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Created reservations ['d5d1c5b5-1014-4ce9-8c93-8be33ed5cc7a', '011d930b-6e58-44cf-aef3-1266cb745d76', 'a9823d68-1df9-488a-a125-6c03fcd7736e', '1c7bc805-8d4b-4d04-ae68-d4eb117afcfa'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:36 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Delete snapshot completed successfully. Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9c515add-99e1-4bac-89f0-d5dd4dc66c4c tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-b1505ea2-3071-4070-ad58-35155bbcfd5c-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:37 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:37 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "cinder-6cf12652-af0e-4172-a5d1-692d1b972fea-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-6cf12652-af0e-4172-a5d1-692d1b972fea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "cinder-quobyte-6cf12652-af0e-4172-a5d1-692d1b972fea" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-quobyte-6cf12652-af0e-4172-a5d1-692d1b972fea" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[845fa702-ae6f-4ff9-8858-f20f33b458d1]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:37 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.274s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:38:37 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea Nov 01 12:38:37 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:37 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea" returned: 0 in 0.376s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:37 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea Nov 01 12:38:37 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:37 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-6cf12652-af0e-4172-a5d1-692d1b972fea" returned: 0 in 0.284s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-quobyte-6cf12652-af0e-4172-a5d1-692d1b972fea" released by "delete_volume" :: held 0.735s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:37 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Created reservations ['f02ae1a9-1a29-4a93-b923-ab777eb03d57', '66cd0e27-b8f4-461c-a654-68df860fb25c', '689fe58e-c7e3-4cb9-9b7f-db49f763280a', 'b1f3a307-74a3-4f00-a077-377abf6d2782'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:38 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:38 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "cinder-4d8bf55f-a1ce-444b-8182-6cdb08582734-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-4d8bf55f-a1ce-444b-8182-6cdb08582734-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "cinder-quobyte-4d8bf55f-a1ce-444b-8182-6cdb08582734" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:38 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-quobyte-4d8bf55f-a1ce-444b-8182-6cdb08582734" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.332s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:38 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Deleted volume successfully. Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0fedc8-47f3-4539-87dd-672306b98729]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-13161116-28d4-4ef0-bbb1-0670b8297852 tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-6cf12652-af0e-4172-a5d1-692d1b972fea-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:38 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734 Nov 01 12:38:38 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:38 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734" returned: 0 in 0.392s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:38 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734 Nov 01 12:38:38 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:39 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4d8bf55f-a1ce-444b-8182-6cdb08582734" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-quobyte-4d8bf55f-a1ce-444b-8182-6cdb08582734" released by "delete_volume" :: held 0.705s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Created reservations ['cd037b88-5cfa-4861-aa2d-b29b1c4ff008', '173ddee3-25e4-46f6-8c7e-089f5a0cef8b', '4f1de2ca-a586-4ce0-b7b0-92d227f7009e', '22f88ee9-c6f5-4d99-975b-0e5ee13415ff'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:39 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:39 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:39 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.269s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Deleted volume successfully. Nov 01 12:38:39 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0696fedc-865c-4bc1-9506-ce00b902f96e tempest-CinderUnicodeTest-1590953102 None] Lock "cinder-4d8bf55f-a1ce-444b-8182-6cdb08582734-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Flow 'volume_create_manager' (62b13327-3c5b-4af7-a00b-29b7d4e2ce57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3999d143-e1da-4d8d-8c91-9b75a717052a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3999d143-e1da-4d8d-8c91-9b75a717052a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1021789598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229db22d-0e36-4f33-a567-c1a6ee7693be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b70f0f7f654dc6919585861f4efeed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:43Z,use_quota=True,user_id='5421f0bac82f4bee98d2ee2700b0af8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8a311b-2888-4d27-82b6-a198f7ee83d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8a311b-2888-4d27-82b6-a198f7ee83d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f4a331-8095-4ea5-bbba-431793a55ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f4a331-8095-4ea5-bbba-431793a55ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '229db22d-0e36-4f33-a567-c1a6ee7693be', 'volume_name': 'volume-229db22d-0e36-4f33-a567-c1a6ee7693be', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de8d05a-3832-4594-b481-17fd12f78894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de8d05a-3832-4594-b481-17fd12f78894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310a4cc7-537a-404c-b3dd-f3ffef14f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:43 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Volume 229db22d-0e36-4f33-a567-c1a6ee7693be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-229db22d-0e36-4f33-a567-c1a6ee7693be', 'volume_size': 1} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1021789598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229db22d-0e36-4f33-a567-c1a6ee7693be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b70f0f7f654dc6919585861f4efeed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:43Z,use_quota=True,user_id='5421f0bac82f4bee98d2ee2700b0af8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Creating volume 229db22d-0e36-4f33-a567-c1a6ee7693be {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:43 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:43 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be 1073741824 Nov 01 12:38:43 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:43 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be 1073741824" returned: 0 in 0.456s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:43 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be Nov 01 12:38:43 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:43 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be" returned: 0 in 0.270s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310a4cc7-537a-404c-b3dd-f3ffef14f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-229db22d-0e36-4f33-a567-c1a6ee7693be', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c1c8a8-ccae-4195-b4cc-5ab32ff187c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:43 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Volume volume-229db22d-0e36-4f33-a567-c1a6ee7693be (229db22d-0e36-4f33-a567-c1a6ee7693be): created successfully Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c1c8a8-ccae-4195-b4cc-5ab32ff187c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Flow 'volume_create_manager' (62b13327-3c5b-4af7-a00b-29b7d4e2ce57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:44 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1e3b4457-8aa7-49c7-af97-e030c6d37d78 tempest-ProjectReaderTests-1543645138 None] Created volume successfully. Nov 01 12:38:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "cinder-229db22d-0e36-4f33-a567-c1a6ee7693be-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-229db22d-0e36-4f33-a567-c1a6ee7693be-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "cinder-quobyte-229db22d-0e36-4f33-a567-c1a6ee7693be" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-quobyte-229db22d-0e36-4f33-a567-c1a6ee7693be" acquired by "delete_volume" :: waited 0.013s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:45 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[36067a82-7afd-493d-9062-7c41d26477c2]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:45 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be Nov 01 12:38:45 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:45 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be" returned: 0 in 0.393s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:45 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be Nov 01 12:38:45 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:46 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-229db22d-0e36-4f33-a567-c1a6ee7693be" returned: 0 in 0.283s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-quobyte-229db22d-0e36-4f33-a567-c1a6ee7693be" released by "delete_volume" :: held 0.736s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Created reservations ['d282297b-5d1e-43a8-8765-8589581200ae', '93edb191-f44b-4f44-8c0c-a209b7505bce', '474e7773-1c08-4cdf-817d-aef00d058693', '565d5a8c-2fdc-4ba4-b2d3-04a8df2ea774'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:46 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:46 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:46 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.309s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Deleted volume successfully. Nov 01 12:38:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-367579a2-cee6-4f9a-8801-a610cd58a7f0 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-229db22d-0e36-4f33-a567-c1a6ee7693be-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Flow 'volume_create_manager' (c9d9f31e-b0e5-463b-a741-71d1843c6594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd7b416-565e-4e55-97fd-613918228120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd7b416-565e-4e55-97fd-613918228120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-254971862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827c2dd9-ccd0-44ff-ab61-6ab854d350da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b70f0f7f654dc6919585861f4efeed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:47Z,use_quota=True,user_id='5421f0bac82f4bee98d2ee2700b0af8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6301a571-614b-46a1-b563-2871cc5ded59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6301a571-614b-46a1-b563-2871cc5ded59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca93bae0-3c83-4596-b100-35a1ee534153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca93bae0-3c83-4596-b100-35a1ee534153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827c2dd9-ccd0-44ff-ab61-6ab854d350da', 'volume_name': 'volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9356923f-81b1-456c-a205-9326fc419574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9356923f-81b1-456c-a205-9326fc419574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd46649-28f3-4f58-9931-c2c0e5d3bb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Volume 827c2dd9-ccd0-44ff-ab61-6ab854d350da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da', 'volume_size': 1} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-254971862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827c2dd9-ccd0-44ff-ab61-6ab854d350da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b70f0f7f654dc6919585861f4efeed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:47Z,use_quota=True,user_id='5421f0bac82f4bee98d2ee2700b0af8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Creating volume 827c2dd9-ccd0-44ff-ab61-6ab854d350da {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:47 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:47 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da 1073741824 Nov 01 12:38:47 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:47 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da 1073741824" returned: 0 in 0.522s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:47 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da Nov 01 12:38:47 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:47 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da" returned: 0 in 0.243s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd46649-28f3-4f58-9931-c2c0e5d3bb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba4cef2-e4ac-4f39-af0d-364b303ec9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Volume volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da (827c2dd9-ccd0-44ff-ab61-6ab854d350da): created successfully Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba4cef2-e4ac-4f39-af0d-364b303ec9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Flow 'volume_create_manager' (c9d9f31e-b0e5-463b-a741-71d1843c6594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8d9b0834-37be-4fa6-a8b9-bb49dede7576 tempest-ProjectReaderTests-1543645138 None] Created volume successfully. Nov 01 12:38:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "cinder-827c2dd9-ccd0-44ff-ab61-6ab854d350da-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-827c2dd9-ccd0-44ff-ab61-6ab854d350da-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "cinder-quobyte-827c2dd9-ccd0-44ff-ab61-6ab854d350da" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-quobyte-827c2dd9-ccd0-44ff-ab61-6ab854d350da" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:49 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a11c570-06cc-4a1f-b3d9-80c59f4f480d]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:49 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da Nov 01 12:38:49 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:49 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da" returned: 0 in 0.420s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:49 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da Nov 01 12:38:49 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:49 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-827c2dd9-ccd0-44ff-ab61-6ab854d350da" returned: 0 in 0.268s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-quobyte-827c2dd9-ccd0-44ff-ab61-6ab854d350da" released by "delete_volume" :: held 0.735s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Created reservations ['d469a6a5-2e49-4df8-a32f-7ea221846829', '112b99d1-dc01-4955-af25-f99125a8a932', 'bf7e962a-f287-4aab-b53f-80214ba9784a', '946c6cee-aeb8-4003-97f4-c969ec62cc75'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:50 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:50 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:50 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.274s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Deleted volume successfully. Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0948f2fd-24ed-4a67-8338-fde2786d3cb7 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-827c2dd9-ccd0-44ff-ab61-6ab854d350da-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Flow 'volume_create_manager' (34a71357-b375-4450-9a9b-e5003eb6a68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1c0e82-94d9-451d-8b1b-6abb7e815480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1c0e82-94d9-451d-8b1b-6abb7e815480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292823140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f32e2c-64e2-4e53-b65d-bb21a8479751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b70f0f7f654dc6919585861f4efeed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:51Z,use_quota=True,user_id='5421f0bac82f4bee98d2ee2700b0af8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2c9821-ba2b-4684-935e-8dbe92b515aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2c9821-ba2b-4684-935e-8dbe92b515aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8a0578-e45a-4bd1-bc03-7f574870b195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c8a0578-e45a-4bd1-bc03-7f574870b195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38f32e2c-64e2-4e53-b65d-bb21a8479751', 'volume_name': 'volume-38f32e2c-64e2-4e53-b65d-bb21a8479751', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2aa0b5-0a29-4178-8d6c-4a37205a17d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f2aa0b5-0a29-4178-8d6c-4a37205a17d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a32d0b-0797-44c8-b8fe-6c8da40df097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:50 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Volume 38f32e2c-64e2-4e53-b65d-bb21a8479751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38f32e2c-64e2-4e53-b65d-bb21a8479751', 'volume_size': 1} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292823140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f32e2c-64e2-4e53-b65d-bb21a8479751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b70f0f7f654dc6919585861f4efeed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:51Z,use_quota=True,user_id='5421f0bac82f4bee98d2ee2700b0af8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Creating volume 38f32e2c-64e2-4e53-b65d-bb21a8479751 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:50 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:50 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751 1073741824 Nov 01 12:38:50 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:51 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751 1073741824" returned: 0 in 0.473s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:51 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751 Nov 01 12:38:51 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:51 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751" returned: 0 in 0.275s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a32d0b-0797-44c8-b8fe-6c8da40df097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f32e2c-64e2-4e53-b65d-bb21a8479751', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a3837d-4776-4fb5-af2d-626b387fb961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:51 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Volume volume-38f32e2c-64e2-4e53-b65d-bb21a8479751 (38f32e2c-64e2-4e53-b65d-bb21a8479751): created successfully Nov 01 12:38:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a3837d-4776-4fb5-af2d-626b387fb961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Flow 'volume_create_manager' (34a71357-b375-4450-9a9b-e5003eb6a68b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:51 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ba75a271-dd76-4bd6-a650-8420cafc081f tempest-ProjectReaderTests-1543645138 None] Created volume successfully. Nov 01 12:38:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "cinder-38f32e2c-64e2-4e53-b65d-bb21a8479751-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-38f32e2c-64e2-4e53-b65d-bb21a8479751-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "cinder-quobyte-38f32e2c-64e2-4e53-b65d-bb21a8479751" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-quobyte-38f32e2c-64e2-4e53-b65d-bb21a8479751" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa472f-9c91-4502-8685-80dbd06a8183]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:53 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751 Nov 01 12:38:53 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:53 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751" returned: 0 in 0.374s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:53 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751 Nov 01 12:38:53 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:53 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-38f32e2c-64e2-4e53-b65d-bb21a8479751" returned: 0 in 0.270s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-quobyte-38f32e2c-64e2-4e53-b65d-bb21a8479751" released by "delete_volume" :: held 0.695s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Created reservations ['2eaa1ea6-95b1-4199-9a42-3cf20283e916', '8256398b-148e-4d3c-9871-84e49e9e1485', '0e5da368-a573-4625-87cd-54da22858dc5', '0f01d716-e701-4645-8d83-0b58e9ffe197'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:53 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:53 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:54 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.262s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:54 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Deleted volume successfully. Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-7af49e3b-da9b-4073-a831-2a96553306a2 tempest-ProjectReaderTests-1543645138 None] Lock "cinder-38f32e2c-64e2-4e53-b65d-bb21a8479751-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Flow 'volume_create_manager' (167b3c65-bcde-49ee-96ad-64c836395dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4790d246-c301-43f8-8313-b084c201d97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4790d246-c301-43f8-8313-b084c201d97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485724656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8be093-d5f6-4261-a9e6-83105763edcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b70f0f7f654dc6919585861f4efeed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:55Z,use_quota=True,user_id='5421f0bac82f4bee98d2ee2700b0af8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc851039-1cca-475a-9948-8351663b5431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc851039-1cca-475a-9948-8351663b5431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d40d7a9-40a5-4b02-af85-b7b6edbf41b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d40d7a9-40a5-4b02-af85-b7b6edbf41b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8be093-d5f6-4261-a9e6-83105763edcf', 'volume_name': 'volume-cf8be093-d5f6-4261-a9e6-83105763edcf', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d577bcb-c9ff-47a4-8d21-b7aac252c691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d577bcb-c9ff-47a4-8d21-b7aac252c691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df344870-1117-4af9-9e0c-dbceb1d27d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:54 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Volume cf8be093-d5f6-4261-a9e6-83105763edcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8be093-d5f6-4261-a9e6-83105763edcf', 'volume_size': 1} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1485724656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8be093-d5f6-4261-a9e6-83105763edcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b70f0f7f654dc6919585861f4efeed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:55Z,use_quota=True,user_id='5421f0bac82f4bee98d2ee2700b0af8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Creating volume cf8be093-d5f6-4261-a9e6-83105763edcf {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:54 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:54 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf 1073741824 Nov 01 12:38:54 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:55 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf 1073741824" returned: 0 in 0.520s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:55 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf Nov 01 12:38:55 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:55 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:55 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df344870-1117-4af9-9e0c-dbceb1d27d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8be093-d5f6-4261-a9e6-83105763edcf', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a24822-a08c-4678-adf3-bbe1abf7a970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:55 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Volume volume-cf8be093-d5f6-4261-a9e6-83105763edcf (cf8be093-d5f6-4261-a9e6-83105763edcf): created successfully Nov 01 12:38:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a24822-a08c-4678-adf3-bbe1abf7a970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:55 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Flow 'volume_create_manager' (167b3c65-bcde-49ee-96ad-64c836395dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:55 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1102329d-ad8f-45bf-a2ff-5d5cf27f8592 tempest-ProjectReaderTests-1543645138 None] Created volume successfully. Nov 01 12:38:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Acquiring lock "cinder-cf8be093-d5f6-4261-a9e6-83105763edcf-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Lock "cinder-cf8be093-d5f6-4261-a9e6-83105763edcf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Acquiring lock "cinder-quobyte-cf8be093-d5f6-4261-a9e6-83105763edcf" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Lock "cinder-quobyte-cf8be093-d5f6-4261-a9e6-83105763edcf" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:56 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b46898-591b-4698-bde5-9a5b83f6bf1a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:57 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf Nov 01 12:38:57 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:57 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf" returned: 0 in 0.427s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:57 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf Nov 01 12:38:57 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:57 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cf8be093-d5f6-4261-a9e6-83105763edcf" returned: 0 in 0.264s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Lock "cinder-quobyte-cf8be093-d5f6-4261-a9e6-83105763edcf" released by "delete_volume" :: held 0.744s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Created reservations ['729b720a-e25a-4685-abcb-b10116d7ef1b', 'e95a144c-12ed-4002-baf9-d799475817fd', '1e0afef8-5179-4490-befc-fbe7bd7a1f6a', 'e1370843-b2a2-4707-988a-f00280f2a230'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:57 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:38:57 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:58 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.289s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:58 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:58 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Deleted volume successfully. Nov 01 12:38:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1e883f2d-5f26-4fad-b6a8-d659382793ef tempest-ProjectReaderTests-1543645138 None] Lock "cinder-cf8be093-d5f6-4261-a9e6-83105763edcf-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Flow 'volume_create_manager' (5cc0c264-d732-4c9d-9240-9601bcf26b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74eefc4f-f12a-44d4-8c46-72784b5b7150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74eefc4f-f12a-44d4-8c46-72784b5b7150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-848130647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d70239e-9882-40e9-b270-08126038ac97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69f7544ba0f4b288cf3974fa5f5fcbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:59Z,use_quota=True,user_id='cc5886997e154050a0d92868edb8a819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4380c29-8ad8-478b-94ac-11bf8a8ad9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4380c29-8ad8-478b-94ac-11bf8a8ad9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20270458-36a9-42c8-8eb9-afc2c7ec3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20270458-36a9-42c8-8eb9-afc2c7ec3493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d70239e-9882-40e9-b270-08126038ac97', 'volume_name': 'volume-3d70239e-9882-40e9-b270-08126038ac97', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43676f50-c463-47d4-85a2-7f56dfac1fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43676f50-c463-47d4-85a2-7f56dfac1fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f331b6-0d4a-449e-9653-fbe51e6f7852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Volume 3d70239e-9882-40e9-b270-08126038ac97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d70239e-9882-40e9-b270-08126038ac97', 'volume_size': 1} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-848130647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d70239e-9882-40e9-b270-08126038ac97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69f7544ba0f4b288cf3974fa5f5fcbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:59Z,use_quota=True,user_id='cc5886997e154050a0d92868edb8a819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Creating volume 3d70239e-9882-40e9-b270-08126038ac97 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:59 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:38:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:59 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 1073741824 Nov 01 12:38:59 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:00 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 1073741824" returned: 0 in 0.513s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:00 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 Nov 01 12:39:00 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:00 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f331b6-0d4a-449e-9653-fbe51e6f7852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d70239e-9882-40e9-b270-08126038ac97', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6115d5-1270-4bbc-b170-1d3aad5be1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:00 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Volume volume-3d70239e-9882-40e9-b270-08126038ac97 (3d70239e-9882-40e9-b270-08126038ac97): created successfully Nov 01 12:39:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6115d5-1270-4bbc-b170-1d3aad5be1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Flow 'volume_create_manager' (5cc0c264-d732-4c9d-9240-9601bcf26b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:00 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-de3fac97-1d98-4943-9f4b-c7455a195f0e tempest-TestImageHashVerification-2039113066 None] Created volume successfully. Nov 01 12:39:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:02 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa783c10-6378-447c-ae25-c3b3b60bac3f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:02 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 Nov 01 12:39:02 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:02 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97" returned: 0 in 0.410s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:02 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e4e44f-d960-4b46-be53-6a3b8b87605b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:02 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 Nov 01 12:39:02 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:03 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97" returned: 0 in 0.369s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 /opt/stack/data/cinder/conversion/3d70239e-9882-40e9-b270-08126038ac97.temp_image.6f5f2fc7-7437-4938-a978-4e500e9de054yy_dgmoj.img {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:03 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 /opt/stack/data/cinder/conversion/3d70239e-9882-40e9-b270-08126038ac97.temp_image.6f5f2fc7-7437-4938-a978-4e500e9de054yy_dgmoj.img Nov 01 12:39:03 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:08 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 /opt/stack/data/cinder/conversion/3d70239e-9882-40e9-b270-08126038ac97.temp_image.6f5f2fc7-7437-4938-a978-4e500e9de054yy_dgmoj.img" returned: 0 in 5.778s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c3531b-6883-484a-b8a8-a3ee95fa59f0]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:09 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 Nov 01 12:39:09 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:09 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97" returned: 0 in 0.530s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:09 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/conversion/3d70239e-9882-40e9-b270-08126038ac97.temp_image.6f5f2fc7-7437-4938-a978-4e500e9de054yy_dgmoj.img {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:39:09 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Converted 1024.00 MB image at 177.18 MB/s Nov 01 12:39:09 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] 6f5f2fc7-7437-4938-a978-4e500e9de054 was raw, no need to convert to raw {{(pid=86812) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 01 12:39:19 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=49,cinder:INSERT=19,cinder:UPDATE=69,cinder:DELETE=4 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:39:19 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=44,cinder:INSERT=14,cinder:UPDATE=69,cinder:DELETE=7 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:39:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.577s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Uploaded volume to glance image-id: 6f5f2fc7-7437-4938-a978-4e500e9de054. {{(pid=86812) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 12:39:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-156aed42-863b-4151-a601-de6f481b92dc tempest-TestImageHashVerification-2039113066 None] Copy volume to image completed successfully. Nov 01 12:39:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Acquiring lock "cinder-3d70239e-9882-40e9-b270-08126038ac97-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Lock "cinder-3d70239e-9882-40e9-b270-08126038ac97-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Acquiring lock "cinder-quobyte-3d70239e-9882-40e9-b270-08126038ac97" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Lock "cinder-quobyte-3d70239e-9882-40e9-b270-08126038ac97" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:28 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e345bee6-242a-466a-bc57-cace3183791c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:28 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 Nov 01 12:39:28 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:29 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97" returned: 0 in 0.349s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:29 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97 Nov 01 12:39:29 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:29 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3d70239e-9882-40e9-b270-08126038ac97" returned: 0 in 0.244s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Lock "cinder-quobyte-3d70239e-9882-40e9-b270-08126038ac97" released by "delete_volume" :: held 0.630s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Created reservations ['8ba599b8-5f24-424f-aa55-64397d6768ad', '2411e99f-793f-4f26-865f-215a05c0b89b', '9f8f837e-8ba1-4723-b028-e0f906f77590', '6a30a3a9-aca9-4a87-be64-de541686b91a'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:29 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:39:29 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:29 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.237s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:29 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Deleted volume successfully. Nov 01 12:39:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bb775286-420e-4973-8da4-b7164d911bea tempest-TestImageHashVerification-2039113066 None] Lock "cinder-3d70239e-9882-40e9-b270-08126038ac97-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:39:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:37 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:39:37 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:37 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:39:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:39:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:39:39 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:39:39 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Flow 'volume_create_manager' (4b80b201-2f06-456e-bf1e-4e0460f73c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8346c1bf-6b1a-4c35-8f35-80155286d04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8346c1bf-6b1a-4c35-8f35-80155286d04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-558269035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0afa755-22d5-42ee-84d2-dbefd8b4ee9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcec99f0c814a7fad8dea060635da41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:40Z,use_quota=True,user_id='e1ee148ac2524b8bac4e703612ccc4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d8f32a-b232-4127-a144-04f2aa7b2521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d8f32a-b232-4127-a144-04f2aa7b2521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fb3e6f-afd5-49bb-b1e4-56cdb29d5d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44fb3e6f-afd5-49bb-b1e4-56cdb29d5d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0afa755-22d5-42ee-84d2-dbefd8b4ee9f', 'volume_name': 'volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f652665d-1cc8-42ad-bbc2-c3bbdea5408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f652665d-1cc8-42ad-bbc2-c3bbdea5408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965c2804-a688-480f-be14-413686f099f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:40 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Volume e0afa755-22d5-42ee-84d2-dbefd8b4ee9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f', 'volume_size': 1} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-558269035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0afa755-22d5-42ee-84d2-dbefd8b4ee9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcec99f0c814a7fad8dea060635da41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:40Z,use_quota=True,user_id='e1ee148ac2524b8bac4e703612ccc4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Creating volume e0afa755-22d5-42ee-84d2-dbefd8b4ee9f {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:40 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:40 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f 1073741824 Nov 01 12:39:40 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:40 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f 1073741824" returned: 0 in 0.409s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:40 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f Nov 01 12:39:40 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:41 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" returned: 0 in 0.241s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (965c2804-a688-480f-be14-413686f099f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492fac88-6d8c-4671-8aa3-91001610f5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:41 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Volume volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f (e0afa755-22d5-42ee-84d2-dbefd8b4ee9f): created successfully Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492fac88-6d8c-4671-8aa3-91001610f5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Flow 'volume_create_manager' (4b80b201-2f06-456e-bf1e-4e0460f73c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:41 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-462700ff-1a00-42d2-970a-bf207abacf59 tempest-VolumeDependencyTests-2009917333 None] Created volume successfully. Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Creating offline snapshot 99f7ac02-4d02-466f-bbf5-ea3dad329669 of volume e0afa755-22d5-42ee-84d2-dbefd8b4ee9f {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcfcd34-4ccd-419b-b367-d50cec0640d5]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:41 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f Nov 01 12:39:41 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:41 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" returned: 0 in 0.354s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:42 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 1G Nov 01 12:39:42 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:42 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 1G" returned: 0 in 0.385s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:42 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 Nov 01 12:39:42 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:42 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669" returned: 0 in 0.293s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:42 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 is being set with open permissions: ugo+rw Nov 01 12:39:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:42 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 Nov 01 12:39:42 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:42 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669" returned: 0 in 0.245s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:42 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.info Nov 01 12:39:42 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:43 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.info" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:43 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.info is being set with open permissions: ugo+rw Nov 01 12:39:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:43 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.info Nov 01 12:39:43 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:43 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.info" returned: 0 in 0.239s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f97f745a-1078-4ece-ad93-bc7fdf7ebf23 tempest-VolumeDependencyTests-2009917333 None] Create snapshot completed successfully Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Flow 'volume_create_manager' (84a5ff67-e81c-4ef8-8eba-f6fbe946db0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0278bdd-929c-42b6-b308-2ef9d3ff7d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0278bdd-929c-42b6-b308-2ef9d3ff7d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1398330716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c59e70-3bff-43b1-ba3a-df6e87bf0190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddcec99f0c814a7fad8dea060635da41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=99f7ac02-4d02-466f-bbf5-ea3dad329669,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:44Z,use_quota=True,user_id='e1ee148ac2524b8bac4e703612ccc4d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0d02fe-a151-45a6-b2ed-a13b9877c3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0d02fe-a151-45a6-b2ed-a13b9877c3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c41575-45ba-40bb-be8d-70582e6524a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c41575-45ba-40bb-be8d-70582e6524a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8c59e70-3bff-43b1-ba3a-df6e87bf0190', 'volume_name': 'volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190', 'volume_size': 1, 'snapshot_id': '99f7ac02-4d02-466f-bbf5-ea3dad329669'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948a4846-5d15-4ae8-a2d6-507abdb0766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (948a4846-5d15-4ae8-a2d6-507abdb0766c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbd278f-fec5-4895-a7e4-c85bd155128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:44 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Volume e8c59e70-3bff-43b1-ba3a-df6e87bf0190: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190', 'volume_size': 1, 'snapshot_id': '99f7ac02-4d02-466f-bbf5-ea3dad329669'} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "cinder-quobyte-99f7ac02-4d02-466f-bbf5-ea3dad329669-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" by "_create_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-99f7ac02-4d02-466f-bbf5-ea3dad329669-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Creating volume e8c59e70-3bff-43b1-ba3a-df6e87bf0190 from snapshot 99f7ac02-4d02-466f-bbf5-ea3dad329669 {{(pid=86812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "cinder-quobyte-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] snapshot: 99f7ac02-4d02-466f-bbf5-ea3dad329669, volume: e8c59e70-3bff-43b1-ba3a-df6e87bf0190, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fc4d3d-dd97-4229-b369-f932fded7c85]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:44 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 Nov 01 12:39:44 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:44 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669" returned: 0 in 0.345s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d132f4ab-08ee-4078-8873-f3bc0d338ff0]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:45 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f Nov 01 12:39:45 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:45 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" returned: 0 in 0.361s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:39:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:39:45 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:39:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:45 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 Nov 01 12:39:45 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:51 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" returned: 0 in 5.755s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:39:51 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Converted 1024.00 MB image at 177.90 MB/s Nov 01 12:39:51 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 is being set with open permissions: ugo+rw Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:51 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 Nov 01 12:39:51 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:51 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" returned: 0 in 0.230s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" released by "_copy_volume_from_snapshot" :: held 6.770s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-99f7ac02-4d02-466f-bbf5-ea3dad329669-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" released by "_create_volume_from_snapshot" :: held 6.829s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.844s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fbd278f-fec5-4895-a7e4-c85bd155128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190', 'volume_size': 1, 'snapshot_id': '99f7ac02-4d02-466f-bbf5-ea3dad329669'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24683ab3-d5c8-4ebc-84bb-b65d2468b137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:51 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Volume volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 (e8c59e70-3bff-43b1-ba3a-df6e87bf0190): created successfully Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24683ab3-d5c8-4ebc-84bb-b65d2468b137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Flow 'volume_create_manager' (84a5ff67-e81c-4ef8-8eba-f6fbe946db0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:51 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b0ec6301-00e5-4a3e-b6ee-0e7a8cd6fb8e tempest-VolumeDependencyTests-2009917333 None] Created volume successfully. Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "cinder-99f7ac02-4d02-466f-bbf5-ea3dad329669-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-99f7ac02-4d02-466f-bbf5-ea3dad329669-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "cinder-quobyte-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "cinder-quobyte-99f7ac02-4d02-466f-bbf5-ea3dad329669" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-99f7ac02-4d02-466f-bbf5-ea3dad329669" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Deleting offline snapshot 99f7ac02-4d02-466f-bbf5-ea3dad329669 of volume e0afa755-22d5-42ee-84d2-dbefd8b4ee9f {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] snapshot_file for this snap is: volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:52 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cefd9d7-a27a-4639-8886-c74eb9e82765]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:52 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 Nov 01 12:39:52 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:52 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669" returned: 0 in 0.347s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:52 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70278f0-ae6a-49f5-9910-9f251a40512a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:52 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f Nov 01 12:39:52 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:52 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" returned: 0 in 0.506s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:52 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 Nov 01 12:39:52 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:53 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669" returned: 0 in 0.320s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:53 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669 Nov 01 12:39:53 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:53 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f.99f7ac02-4d02-466f-bbf5-ea3dad329669" returned: 0 in 0.237s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-99f7ac02-4d02-466f-bbf5-ea3dad329669" released by "_delete_snapshot" :: held 1.504s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" released by "delete_snapshot" :: held 1.527s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:53 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Created reservations ['c298132d-95b1-4b94-b0ce-4a7e3c2dfbf4', 'ad7c2f8a-9bc7-4d45-9190-084b5f824a60', '9a346af2-7530-4ef7-baf2-644809a53828', '6e27b139-a6df-43b5-aa5e-42f5c7c0fbb7'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:53 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Delete snapshot completed successfully. Nov 01 12:39:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-34647d4c-d9f5-4179-bbf2-d002bd847023 tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-99f7ac02-4d02-466f-bbf5-ea3dad329669-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "cinder-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "cinder-quobyte-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" acquired by "delete_volume" :: waited 0.013s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3d415e-605e-4c93-afb5-5c8926bab673]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:54 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f Nov 01 12:39:54 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:54 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" returned: 0 in 0.359s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:54 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f Nov 01 12:39:54 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:54 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" returned: 0 in 0.242s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f" released by "delete_volume" :: held 0.659s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Created reservations ['4b28234c-bce1-48a2-af28-905402c343f0', '3ee537ef-40c6-4424-b6b3-9cfe2b013974', 'c001dc2e-410d-486a-9a72-81ccc835dd28', '5e0724ca-bd73-4fee-ab0e-46a0fbe7627e'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:54 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:39:54 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:55 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.237s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:55 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Deleted volume successfully. Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5276dc64-4559-4a5a-8aa6-2e5afe16d38e tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-e0afa755-22d5-42ee-84d2-dbefd8b4ee9f-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "cinder-e8c59e70-3bff-43b1-ba3a-df6e87bf0190-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-e8c59e70-3bff-43b1-ba3a-df6e87bf0190-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "cinder-quobyte-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ace86-0125-4e36-a887-6c46278c9d32]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:55 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 Nov 01 12:39:55 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:55 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" returned: 0 in 0.349s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:55 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190 Nov 01 12:39:55 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:55 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" returned: 0 in 0.242s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-quobyte-e8c59e70-3bff-43b1-ba3a-df6e87bf0190" released by "delete_volume" :: held 0.632s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:55 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Created reservations ['696f71c4-7454-4b2c-8132-1ecc907526ab', '2c39ade8-ded4-4d02-b0cd-cf606c97246a', '445be716-2a56-4f51-a779-f8658ab472ac', '767f5245-e9d5-4dd0-883e-aa65b48d207e'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:56 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:39:56 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:56 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.228s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:56 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Deleted volume successfully. Nov 01 12:39:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ddec239e-f3ef-432d-a1a6-81473825e6d1 tempest-VolumeDependencyTests-2009917333 None] Lock "cinder-e8c59e70-3bff-43b1-ba3a-df6e87bf0190-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:06 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=25,cinder:SELECT=27,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:40:06 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=22,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Flow 'volume_create_manager' (5e771149-fbe8-4312-bdfe-11970fc74bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9bd1c2-650b-4208-9c1a-3b47937ad1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9bd1c2-650b-4208-9c1a-3b47937ad1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-454937317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315998dd-fa87-43f4-8fb0-633b9fdda6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c75758b569c46dd8bf6344077ee4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:12Z,use_quota=True,user_id='9283466a7e4b4d90ab78a635feedbcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e36369-f602-4e02-bf71-7c7b5e894dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e36369-f602-4e02-bf71-7c7b5e894dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c339d73a-31a4-491a-8d72-7f47acc8daa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c339d73a-31a4-491a-8d72-7f47acc8daa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315998dd-fa87-43f4-8fb0-633b9fdda6f7', 'volume_name': 'volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efe73ab-6181-4e2a-98a7-1580645ae5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6efe73ab-6181-4e2a-98a7-1580645ae5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b150f154-9633-4399-bb60-bec261839570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:12 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Volume 315998dd-fa87-43f4-8fb0-633b9fdda6f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7', 'volume_size': 1} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-454937317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315998dd-fa87-43f4-8fb0-633b9fdda6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c75758b569c46dd8bf6344077ee4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:12Z,use_quota=True,user_id='9283466a7e4b4d90ab78a635feedbcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Creating volume 315998dd-fa87-43f4-8fb0-633b9fdda6f7 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:12 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:12 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7 1073741824 Nov 01 12:40:12 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (18e96c41-ff4c-4ae0-88a5-026fa584179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b5d424-70ad-4a4f-aa16-be6418c62f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b5d424-70ad-4a4f-aa16-be6418c62f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1488866346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f80708-e71b-4b94-a432-9d2eb65f87c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:13Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569cce30-24bd-4dc6-affa-6900c895dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (569cce30-24bd-4dc6-affa-6900c895dffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9076b8ae-ad01-459a-8589-3f612507ff0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9076b8ae-ad01-459a-8589-3f612507ff0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4f80708-e71b-4b94-a432-9d2eb65f87c7', 'volume_name': 'volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca221ce7-d473-4fb9-af3a-10afdfa4273d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca221ce7-d473-4fb9-af3a-10afdfa4273d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d7b709-fbd9-4776-a6a6-8eaad8752c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:12 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume d4f80708-e71b-4b94-a432-9d2eb65f87c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7', 'volume_size': 1} Nov 01 12:40:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Flow 'volume_create_manager' (9a43f35b-883d-42ba-ba82-c46d685f1d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1532aa0-d8d0-478e-b1de-5e296a0a76aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1532aa0-d8d0-478e-b1de-5e296a0a76aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1536056809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a42c211-9778-4f65-8969-5bcdfeb4a5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c75758b569c46dd8bf6344077ee4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:13Z,use_quota=True,user_id='9283466a7e4b4d90ab78a635feedbcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34445da0-0f84-4a5a-8207-ab3233e10605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34445da0-0f84-4a5a-8207-ab3233e10605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49528000-0555-4738-a3c5-b741ed67c47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49528000-0555-4738-a3c5-b741ed67c47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a42c211-9778-4f65-8969-5bcdfeb4a5ad', 'volume_name': 'volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a8d241-4c92-412e-b637-16957af55472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a8d241-4c92-412e-b637-16957af55472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d301c8ae-e599-4af0-bf0f-b55cbd76b84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Volume 7a42c211-9778-4f65-8969-5bcdfeb4a5ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad', 'volume_size': 1} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:13 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7 1073741824" returned: 0 in 0.753s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:13 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7 Nov 01 12:40:13 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Flow 'volume_create_manager' (b3501e43-32cd-4216-9e04-8f103be72725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3edbda7-322f-42fd-af42-5466ccbe4364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3edbda7-322f-42fd-af42-5466ccbe4364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1543076195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2d9cb9-7684-49c7-808f-ece77699ad71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c75758b569c46dd8bf6344077ee4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:13Z,use_quota=True,user_id='9283466a7e4b4d90ab78a635feedbcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b976cd0b-cfac-4328-beff-4d31e5297e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b976cd0b-cfac-4328-beff-4d31e5297e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d67926a-5d2a-4bf9-8261-7da0312b874d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d67926a-5d2a-4bf9-8261-7da0312b874d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2d9cb9-7684-49c7-808f-ece77699ad71', 'volume_name': 'volume-2f2d9cb9-7684-49c7-808f-ece77699ad71', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8ca80b-5cf2-4b0d-a9dc-6da9e498a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa8ca80b-5cf2-4b0d-a9dc-6da9e498a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb570dd-64a6-4a02-be87-f0d21f3a34f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Volume 2f2d9cb9-7684-49c7-808f-ece77699ad71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2d9cb9-7684-49c7-808f-ece77699ad71', 'volume_size': 1} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:13 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7" returned: 0 in 0.416s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1488866346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4f80708-e71b-4b94-a432-9d2eb65f87c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:13Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Creating volume d4f80708-e71b-4b94-a432-9d2eb65f87c7 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:13 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:13 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 1073741824 Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b150f154-9633-4399-bb60-bec261839570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:13 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab188561-2421-40ae-84fb-6557d0e272e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:13 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Volume volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7 (315998dd-fa87-43f4-8fb0-633b9fdda6f7): created successfully Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab188561-2421-40ae-84fb-6557d0e272e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:13 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Flow 'volume_create_manager' (5e771149-fbe8-4312-bdfe-11970fc74bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:13 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4e3b98ab-c83d-4974-9ce4-2dac24d8c7c1 tempest-CreateVolumesFromImageTest-1889538050 None] Created volume successfully. Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Flow 'volume_create_manager' (36f7c0d6-bdab-4107-afa0-df3499883e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4de009-fba6-4b09-9d1d-26273b9bc105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4de009-fba6-4b09-9d1d-26273b9bc105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1054791978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46d4089-ee66-4f00-8748-5ac5b9c84bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c75758b569c46dd8bf6344077ee4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:14Z,use_quota=True,user_id='9283466a7e4b4d90ab78a635feedbcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596966e0-1207-4c2c-a1ee-b9bb013f6652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596966e0-1207-4c2c-a1ee-b9bb013f6652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec392c4-37f6-4623-a4cd-cacb95b03227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ec392c4-37f6-4623-a4cd-cacb95b03227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46d4089-ee66-4f00-8748-5ac5b9c84bc7', 'volume_name': 'volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5b37b2-6e79-4b6c-a756-6af3f466b3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5b37b2-6e79-4b6c-a756-6af3f466b3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130100fd-92f0-44a4-b021-a021de78e74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Volume a46d4089-ee66-4f00-8748-5ac5b9c84bc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7', 'volume_size': 1} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:14 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 1073741824" returned: 0 in 0.763s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:14 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 Nov 01 12:40:14 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Flow 'volume_create_manager' (cf803c10-2d4c-4386-9c62-f70256f843b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c121c6-584e-427c-a86b-bb83654f8520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c121c6-584e-427c-a86b-bb83654f8520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1245416108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936f7f5f-3438-4df8-9781-6f2ba4151a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c75758b569c46dd8bf6344077ee4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:15Z,use_quota=True,user_id='9283466a7e4b4d90ab78a635feedbcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42386b2c-3f00-4b5f-83bd-a128d3ff5da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42386b2c-3f00-4b5f-83bd-a128d3ff5da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4971f9-a62a-4029-b5f8-7dc94d2cf175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4971f9-a62a-4029-b5f8-7dc94d2cf175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '936f7f5f-3438-4df8-9781-6f2ba4151a17', 'volume_name': 'volume-936f7f5f-3438-4df8-9781-6f2ba4151a17', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d535f5-5eaf-4453-aa5a-b03ad2401563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d535f5-5eaf-4453-aa5a-b03ad2401563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c45d1b1-b152-4997-bf46-cf137a9c7f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Volume 936f7f5f-3438-4df8-9781-6f2ba4151a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-936f7f5f-3438-4df8-9781-6f2ba4151a17', 'volume_size': 1} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:14 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7" returned: 0 in 0.293s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1536056809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a42c211-9778-4f65-8969-5bcdfeb4a5ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c75758b569c46dd8bf6344077ee4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:13Z,use_quota=True,user_id='9283466a7e4b4d90ab78a635feedbcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Creating volume 7a42c211-9778-4f65-8969-5bcdfeb4a5ad {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:14 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d7b709-fbd9-4776-a6a6-8eaad8752c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a03aa3e-36bd-4630-a245-58895491210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:14 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad 1073741824 Nov 01 12:40:14 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:14 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 (d4f80708-e71b-4b94-a432-9d2eb65f87c7): created successfully Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a03aa3e-36bd-4630-a245-58895491210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (18e96c41-ff4c-4ae0-88a5-026fa584179f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:14 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e6d818a9-dfa5-4b79-9165-1a58a2287b6e tempest-CreateVolumesFromSnapshotTest-991106065 None] Created volume successfully. Nov 01 12:40:15 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad 1073741824" returned: 0 in 0.528s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:15 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad Nov 01 12:40:15 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:15 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad" returned: 0 in 0.278s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.033s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1543076195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2d9cb9-7684-49c7-808f-ece77699ad71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c75758b569c46dd8bf6344077ee4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:13Z,use_quota=True,user_id='9283466a7e4b4d90ab78a635feedbcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Creating volume 2f2d9cb9-7684-49c7-808f-ece77699ad71 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:15 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:15 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71 1073741824 Nov 01 12:40:15 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d301c8ae-e599-4af0-bf0f-b55cbd76b84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cb23e5-b227-4b65-b8c3-3b3ad1c12342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:15 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Volume volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad (7a42c211-9778-4f65-8969-5bcdfeb4a5ad): created successfully Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1cb23e5-b227-4b65-b8c3-3b3ad1c12342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:15 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Flow 'volume_create_manager' (9a43f35b-883d-42ba-ba82-c46d685f1d2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:15 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8e3ac648-4a60-4fed-9680-f7c1ae9ece50 tempest-CreateVolumesFromImageTest-1889538050 None] Created volume successfully. Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:16 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71 1073741824" returned: 0 in 0.618s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:16 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71 Nov 01 12:40:16 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:16 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71" returned: 0 in 0.270s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.499s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1054791978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46d4089-ee66-4f00-8748-5ac5b9c84bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c75758b569c46dd8bf6344077ee4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:14Z,use_quota=True,user_id='9283466a7e4b4d90ab78a635feedbcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Creating volume a46d4089-ee66-4f00-8748-5ac5b9c84bc7 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:16 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:16 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7 1073741824 Nov 01 12:40:16 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb570dd-64a6-4a02-be87-f0d21f3a34f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2d9cb9-7684-49c7-808f-ece77699ad71', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3bd4ef-1f68-4a6a-99a1-829e6fd40201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:16 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Volume volume-2f2d9cb9-7684-49c7-808f-ece77699ad71 (2f2d9cb9-7684-49c7-808f-ece77699ad71): created successfully Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3bd4ef-1f68-4a6a-99a1-829e6fd40201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Flow 'volume_create_manager' (b3501e43-32cd-4216-9e04-8f103be72725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0af415e3-09f9-49de-a672-a98f0a46bb0c tempest-CreateVolumesFromImageTest-1889538050 None] Created volume successfully. Nov 01 12:40:17 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7 1073741824" returned: 0 in 0.576s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:17 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7 Nov 01 12:40:17 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Flow 'volume_create_manager' (dcb4c42e-df36-4dbf-9d31-d1c0c0ccc3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7711a1-a6c3-4068-ba88-bb5ca58c9700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:17 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7" returned: 0 in 0.315s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.887s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1245416108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936f7f5f-3438-4df8-9781-6f2ba4151a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c75758b569c46dd8bf6344077ee4c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:15Z,use_quota=True,user_id='9283466a7e4b4d90ab78a635feedbcdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Creating volume 936f7f5f-3438-4df8-9781-6f2ba4151a17 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:17 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7711a1-a6c3-4068-ba88-bb5ca58c9700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6cde31-24ca-4e80-9d22-9c4a81a4f247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f0f626ecbd496da35c86ac365e2d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:18Z,use_quota=True,user_id='8ae287150244493f96691eb57bf7bfb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca6a9585-73cb-4bc7-aed2-d80fc06ba29b),volume_type_id=ca6a9585-73cb-4bc7-aed2-d80fc06ba29b)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46b5d3c-4955-49f1-bfea-77adcfc00e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:17 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17 1073741824 Nov 01 12:40:17 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46b5d3c-4955-49f1-bfea-77adcfc00e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a65cba1-2481-40e2-a4cb-56c856e93702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.image.glance [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Creating Keystone auth plugin from conf {{(pid=86812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (130100fd-92f0-44a4-b021-a021de78e74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd9ab8d-47a5-4c15-9d88-701a3ebd7f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:17 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Volume volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7 (a46d4089-ee66-4f00-8748-5ac5b9c84bc7): created successfully Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd9ab8d-47a5-4c15-9d88-701a3ebd7f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Flow 'volume_create_manager' (36f7c0d6-bdab-4107-afa0-df3499883e1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:17 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-955825fe-ee2c-4ea9-95a9-b89431adad68 tempest-CreateVolumesFromImageTest-1889538050 None] Created volume successfully. Nov 01 12:40:18 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17 1073741824" returned: 0 in 0.513s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:18 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17 Nov 01 12:40:18 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a65cba1-2481-40e2-a4cb-56c856e93702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d6cde31-24ca-4e80-9d22-9c4a81a4f247', 'volume_name': 'volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247', 'volume_size': 1, 'image_id': '7d19764d-5130-466b-8d21-7ec20fb6999d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d19764d-5130-466b-8d21-7ec20fb6999d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd8ccbc9c8d4259b42a67bfb5daf174f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0f0f626ecbd496da35c86ac365e2d7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4811ea7308cc13ca54a9bc5ea8092c12bf7f37dfcfbfb8391b32a4d5a02ab09461a8884212f7b124670d160b6453a5900cc5c24c853a153cc6ee9e448e808fb0', 'id': '7d19764d-5130-466b-8d21-7ec20fb6999d', 'created_at': datetime.datetime(2026, 11, 1, 11, 40, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 40, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d19764d-5130-466b-8d21-7ec20fb6999d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0288f02a-1fb2-497d-8903-922667abe5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0288f02a-1fb2-497d-8903-922667abe5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efb09fe-24bc-43a3-b282-85eb3a55e197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:18 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Volume 7d6cde31-24ca-4e80-9d22-9c4a81a4f247: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247', 'volume_size': 1, 'image_id': '7d19764d-5130-466b-8d21-7ec20fb6999d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d19764d-5130-466b-8d21-7ec20fb6999d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd8ccbc9c8d4259b42a67bfb5daf174f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0f0f626ecbd496da35c86ac365e2d7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4811ea7308cc13ca54a9bc5ea8092c12bf7f37dfcfbfb8391b32a4d5a02ab09461a8884212f7b124670d160b6453a5900cc5c24c853a153cc6ee9e448e808fb0', 'id': '7d19764d-5130-466b-8d21-7ec20fb6999d', 'created_at': datetime.datetime(2026, 11, 1, 11, 40, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 40, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d19764d-5130-466b-8d21-7ec20fb6999d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Trying to clone 7d6cde31-24ca-4e80-9d22-9c4a81a4f247 from image 7d19764d-5130-466b-8d21-7ec20fb6999d at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d19764d-5130-466b-8d21-7ec20fb6999d', 'metadata': {}}]). {{(pid=86812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:40:18 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17" returned: 0 in 0.276s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.257s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Creating offline snapshot bc1b6205-4044-4bf9-85fe-e1a05832e91d of volume d4f80708-e71b-4b94-a432-9d2eb65f87c7 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c45d1b1-b152-4997-bf46-cf137a9c7f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936f7f5f-3438-4df8-9781-6f2ba4151a17', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c241f0e9-0480-42f7-a6db-cfd4296d3a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6cdd83-d757-4433-95bb-bd06f101c8c9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:40:18 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Image download 0.00 MB at 0.00 MB/s Nov 01 12:40:18 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Volume volume-936f7f5f-3438-4df8-9781-6f2ba4151a17 (936f7f5f-3438-4df8-9781-6f2ba4151a17): created successfully Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c241f0e9-0480-42f7-a6db-cfd4296d3a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Flow 'volume_create_manager' (cf803c10-2d4c-4386-9c62-f70256f843b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:18 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4dbfcc20-bad2-4bd4-a72d-f9e52742c556 tempest-CreateVolumesFromImageTest-1889538050 None] Created volume successfully. Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[678de1f5-b0b8-4e49-8e55-0ece812b19c0]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:18 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 Nov 01 12:40:18 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:18 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD Nov 01 12:40:18 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:18 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:18 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7" returned: 0 in 0.431s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:19 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d 1G Nov 01 12:40:19 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "cinder-936f7f5f-3438-4df8-9781-6f2ba4151a17-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-936f7f5f-3438-4df8-9781-6f2ba4151a17-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "cinder-quobyte-936f7f5f-3438-4df8-9781-6f2ba4151a17" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:19 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD Nov 01 12:40:19 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-quobyte-936f7f5f-3438-4df8-9781-6f2ba4151a17" acquired by "delete_volume" :: waited 0.026s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0baa16a9-d012-4f8e-9c4c-5166f0918f1c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:19 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17 Nov 01 12:40:19 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:19 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Temporary image 7d19764d-5130-466b-8d21-7ec20fb6999d is fetched for user 8ae287150244493f96691eb57bf7bfb6. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc0bfe-fccb-4688-8ba3-0b0c3a1e67f4]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:19 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d 1G" returned: 0 in 0.526s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:19 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d Nov 01 12:40:19 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:19 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD Nov 01 12:40:19 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:19 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17" returned: 0 in 0.412s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:19 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17 Nov 01 12:40:19 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:19 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:19 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d" returned: 0 in 0.343s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:19 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d is being set with open permissions: ugo+rw Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:19 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-936f7f5f-3438-4df8-9781-6f2ba4151a17" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:19 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d Nov 01 12:40:19 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-quobyte-936f7f5f-3438-4df8-9781-6f2ba4151a17" released by "delete_volume" :: held 0.717s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Created reservations ['ff9370b0-a68e-407d-a1b9-7d9fa3c89ed3', 'efcd88a6-99e3-4bb5-b699-011634dcd23c', '81216ad7-38c8-42d7-82bb-4d0482bd2839', '60eca9a4-2237-43d8-8957-f566647d2a35'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:19 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD Nov 01 12:40:19 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:20 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:20 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:20 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:20 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:20 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.info Nov 01 12:40:20 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "cinder-a46d4089-ee66-4f00-8748-5ac5b9c84bc7-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:20 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.355s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-a46d4089-ee66-4f00-8748-5ac5b9c84bc7-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:20 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Deleted volume successfully. Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-c4ada976-0603-4b04-8822-e6df14ca640e tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-936f7f5f-3438-4df8-9781-6f2ba4151a17-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "cinder-quobyte-a46d4089-ee66-4f00-8748-5ac5b9c84bc7" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-quobyte-a46d4089-ee66-4f00-8748-5ac5b9c84bc7" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d056528c-728e-4e71-9cc3-976be115f700]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:20 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.info" returned: 0 in 0.340s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:20 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.info is being set with open permissions: ugo+rw Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:20 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.info Nov 01 12:40:20 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:20 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7 Nov 01 12:40:20 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:20 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.info" returned: 0 in 0.287s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.600s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6cde31-24ca-4e80-9d22-9c4a81a4f247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f0f626ecbd496da35c86ac365e2d7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:18Z,use_quota=True,user_id='8ae287150244493f96691eb57bf7bfb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca6a9585-73cb-4bc7-aed2-d80fc06ba29b),volume_type_id=ca6a9585-73cb-4bc7-aed2-d80fc06ba29b)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Creating volume 7d6cde31-24ca-4e80-9d22-9c4a81a4f247 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:20 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:20 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 1073741824 Nov 01 12:40:20 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:20 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5286ca6f-9fbe-495d-96fb-e63e6609d64a tempest-CreateVolumesFromSnapshotTest-991106065 None] Create snapshot completed successfully Nov 01 12:40:20 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7" returned: 0 in 0.451s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:20 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7 Nov 01 12:40:20 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:21 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a46d4089-ee66-4f00-8748-5ac5b9c84bc7" returned: 0 in 0.300s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-quobyte-a46d4089-ee66-4f00-8748-5ac5b9c84bc7" released by "delete_volume" :: held 0.797s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Created reservations ['ee5d34a2-1745-4254-98b8-c4d9af574b31', '3881f711-4cbc-4310-b2d9-4a8f69cf97a9', '67b0e667-b355-41ed-afa3-1d6f7bbbc3d4', 'ad6c5b57-d4f0-4388-8e30-cf392dc269a5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:21 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 1073741824" returned: 0 in 0.519s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:21 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:21 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:21 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 Nov 01 12:40:21 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "cinder-2f2d9cb9-7684-49c7-808f-ece77699ad71-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-2f2d9cb9-7684-49c7-808f-ece77699ad71-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "cinder-quobyte-2f2d9cb9-7684-49c7-808f-ece77699ad71" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-quobyte-2f2d9cb9-7684-49c7-808f-ece77699ad71" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:21 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.293s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a291f7d-be29-4c30-9102-26fe0fb64808]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:21 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Deleted volume successfully. Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bb08330-b5b6-4c08-897b-1ed9e47b0e29 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-a46d4089-ee66-4f00-8748-5ac5b9c84bc7-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:21 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247" returned: 0 in 0.340s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Attempting download of 7d19764d-5130-466b-8d21-7ec20fb6999d ((None, [{'url': 'file:///opt/stack/data/glance/images/7d19764d-5130-466b-8d21-7ec20fb6999d', 'metadata': {}}])) to volume 7d6cde31-24ca-4e80-9d22-9c4a81a4f247. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:40:21 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71 Nov 01 12:40:21 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd95fff4-15f9-44d6-aa95-9b37c7008a80]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d19764d-5130-466b-8d21-7ec20fb6999d_ophydhj5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:21 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d19764d-5130-466b-8d21-7ec20fb6999d_ophydhj5 Nov 01 12:40:21 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:22 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71" returned: 0 in 0.476s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (d573794f-2c5e-43bf-8308-cfcfe7656dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:22 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71 Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9e7e84-b559-4c7d-b4a2-ffe47e20f888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:22 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:22 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9e7e84-b559-4c7d-b4a2-ffe47e20f888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-599199660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075823c3-a94b-4c08-a05a-2b29f8a1ffb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:22Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4352b5c1-30fc-4f03-bd4f-d792dc56940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4352b5c1-30fc-4f03-bd4f-d792dc56940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6e14f5-32b0-420d-835a-bc35d19a2871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6e14f5-32b0-420d-835a-bc35d19a2871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '075823c3-a94b-4c08-a05a-2b29f8a1ffb0', 'volume_name': 'volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523dcc8e-5cf6-4a7f-965f-a821db78dd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (523dcc8e-5cf6-4a7f-965f-a821db78dd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad098e7-41f9-4d01-8875-fa6b71ea0714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:22 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume 075823c3-a94b-4c08-a05a-2b29f8a1ffb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0', 'volume_size': 1} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-599199660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=075823c3-a94b-4c08-a05a-2b29f8a1ffb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:22Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Creating volume 075823c3-a94b-4c08-a05a-2b29f8a1ffb0 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:22 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d19764d-5130-466b-8d21-7ec20fb6999d_ophydhj5" returned: 0 in 0.462s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d19764d-5130-466b-8d21-7ec20fb6999d_ophydhj5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:22 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0 1073741824 Nov 01 12:40:22 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:22 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d19764d-5130-466b-8d21-7ec20fb6999d_ophydhj5 Nov 01 12:40:22 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:22 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2f2d9cb9-7684-49c7-808f-ece77699ad71" returned: 0 in 0.525s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-quobyte-2f2d9cb9-7684-49c7-808f-ece77699ad71" released by "delete_volume" :: held 1.073s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Created reservations ['2c1be4f3-1d59-45d3-b927-60f5d828fb36', '32e814fb-516c-4bc2-bbfb-32152d2b64ba', 'fd58c95c-6701-48b9-8b52-d7dec14f49e4', '4dda1734-36e0-4bda-b9ac-797806867c18'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:22 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (9fd098cc-e9d4-4b40-9221-f90ffc024197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c24d94-902e-40b4-83b0-8a057944dca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d19764d-5130-466b-8d21-7ec20fb6999d_ophydhj5" returned: 1 in 0.552s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d19764d-5130-466b-8d21-7ec20fb6999d_ophydhj5' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8650865e-3cc8-4e99-9c67-3795dc322621]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c24d94-902e-40b4-83b0-8a057944dca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1246684207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03a181f-ba61-4f72-a855-872bfc0f809f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:23Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ec318f-de9c-4da0-aad8-5f29b876c40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ec318f-de9c-4da0-aad8-5f29b876c40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df64deef-af8e-4e72-8302-f4d8be37fd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df64deef-af8e-4e72-8302-f4d8be37fd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03a181f-ba61-4f72-a855-872bfc0f809f', 'volume_name': 'volume-d03a181f-ba61-4f72-a855-872bfc0f809f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35f5629-217f-4fa0-b126-435b6a5800c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35f5629-217f-4fa0-b126-435b6a5800c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220b2a6f-4baf-48a7-b6bb-e7fac9846e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:22 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume d03a181f-ba61-4f72-a855-872bfc0f809f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03a181f-ba61-4f72-a855-872bfc0f809f', 'volume_size': 1} Nov 01 12:40:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:23 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0 1073741824" returned: 0 in 0.787s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:23 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD Nov 01 12:40:23 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:23 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:23 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:23 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0 Nov 01 12:40:23 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (f282ceb9-d8ad-457a-82c5-6715b48357e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616772cb-2aca-49ba-9f1f-94f717bee0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:23 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616772cb-2aca-49ba-9f1f-94f717bee0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-762886147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe8acbd-92b0-4a7b-a593-ee3a321c496d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:23Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdce44fd-d78d-4183-8c2f-a0ca98eb0029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdce44fd-d78d-4183-8c2f-a0ca98eb0029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff0c911-2261-4612-9fea-4d19413df079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff0c911-2261-4612-9fea-4d19413df079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe8acbd-92b0-4a7b-a593-ee3a321c496d', 'volume_name': 'volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb52bb5-6ce6-47ea-9ae9-2faeaab3f5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb52bb5-6ce6-47ea-9ae9-2faeaab3f5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace9f856-6599-482e-b08c-efd401fd987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:23 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume 8fe8acbd-92b0-4a7b-a593-ee3a321c496d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d', 'volume_size': 1} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:23 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.501s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Deleted volume successfully. Nov 01 12:40:23 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0" returned: 0 in 0.468s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1246684207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03a181f-ba61-4f72-a855-872bfc0f809f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:23Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Creating volume d03a181f-ba61-4f72-a855-872bfc0f809f {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:23 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad098e7-41f9-4d01-8875-fa6b71ea0714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:23 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f 1073741824 Nov 01 12:40:23 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf1cbb8-9ee6-4bab-80d4-8b8036357c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:23 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD Nov 01 12:40:23 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bf886aac-feac-4b23-8890-007991b6c43d tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-2f2d9cb9-7684-49c7-808f-ece77699ad71-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:23 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0 (075823c3-a94b-4c08-a05a-2b29f8a1ffb0): created successfully Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf1cbb8-9ee6-4bab-80d4-8b8036357c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (d573794f-2c5e-43bf-8308-cfcfe7656dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ac7a8bc4-5e5d-47c0-ab61-0b2f0fc46df1 tempest-CreateVolumesFromSnapshotTest-991106065 None] Created volume successfully. Nov 01 12:40:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "cinder-7a42c211-9778-4f65-8969-5bcdfeb4a5ad-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:24 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-7a42c211-9778-4f65-8969-5bcdfeb4a5ad-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD" returned: 1 in 0.514s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] 7d19764d-5130-466b-8d21-7ec20fb6999d was raw, converting to qcow2 {{(pid=86812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:24 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 Nov 01 12:40:24 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "cinder-quobyte-7a42c211-9778-4f65-8969-5bcdfeb4a5ad" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-quobyte-7a42c211-9778-4f65-8969-5bcdfeb4a5ad" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ffa9cf-00a3-4de4-8ae8-60cf3d6e0bfe]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:24 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f 1073741824" returned: 0 in 0.683s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:24 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad Nov 01 12:40:24 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:24 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f Nov 01 12:40:24 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:24 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f" returned: 0 in 0.318s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.183s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-762886147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe8acbd-92b0-4a7b-a593-ee3a321c496d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:23Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Creating volume 8fe8acbd-92b0-4a7b-a593-ee3a321c496d {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:24 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:24 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:24 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad" returned: 0 in 0.531s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247" returned: 0 in 0.697s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:24 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d 1073741824 Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d19764d-5130-466b-8d21-7ec20fb6999d_d3o5uttfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:40:24 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 12:40:24 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220b2a6f-4baf-48a7-b6bb-e7fac9846e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03a181f-ba61-4f72-a855-872bfc0f809f', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf70516-c9e0-41f6-93f9-54b14b38b7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:24 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad Nov 01 12:40:24 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:24 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 1G Nov 01 12:40:24 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:24 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume volume-d03a181f-ba61-4f72-a855-872bfc0f809f (d03a181f-ba61-4f72-a855-872bfc0f809f): created successfully Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf70516-c9e0-41f6-93f9-54b14b38b7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (9fd098cc-e9d4-4b40-9221-f90ffc024197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:24 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-fb185baa-a541-47f3-88e6-b1b93238f82e tempest-CreateVolumesFromSnapshotTest-991106065 None] Created volume successfully. Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (dc7b993f-a420-45fb-af6d-028a52352624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9307d7ed-2230-4a20-97da-f4ab71617944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (e74bb39a-9338-4063-b68c-cbabe882e5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1abf928-1933-490f-a9e5-04f4e63b9800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1abf928-1933-490f-a9e5-04f4e63b9800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-831243619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2460777-0ed5-4819-b4da-6e9746047059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:25Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014ea631-7822-4305-8e2c-a81de05f8085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014ea631-7822-4305-8e2c-a81de05f8085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8abe33-c2bf-4041-bd36-2c683b96110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8abe33-c2bf-4041-bd36-2c683b96110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2460777-0ed5-4819-b4da-6e9746047059', 'volume_name': 'volume-f2460777-0ed5-4819-b4da-6e9746047059', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3843c52e-91e6-48ac-87fd-40ff9563796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3843c52e-91e6-48ac-87fd-40ff9563796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e878918a-57be-497b-81ed-9196fa08b539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume f2460777-0ed5-4819-b4da-6e9746047059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2460777-0ed5-4819-b4da-6e9746047059', 'volume_size': 1} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9307d7ed-2230-4a20-97da-f4ab71617944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1375498214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621bed03-6aed-4a3b-8cf3-bf3a65e6803b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:25Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceacc7a5-9065-4ac0-9eef-6efd03bbfca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceacc7a5-9065-4ac0-9eef-6efd03bbfca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a035a45-7807-42e8-8d8b-2aee249e3ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a035a45-7807-42e8-8d8b-2aee249e3ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621bed03-6aed-4a3b-8cf3-bf3a65e6803b', 'volume_name': 'volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b804d694-01c9-4c6d-8902-f4b3aa6282aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b804d694-01c9-4c6d-8902-f4b3aa6282aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ee8e44-257d-40b8-a595-08fc49010c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume 621bed03-6aed-4a3b-8cf3-bf3a65e6803b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b', 'volume_size': 1} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7a42c211-9778-4f65-8969-5bcdfeb4a5ad" returned: 0 in 0.454s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-quobyte-7a42c211-9778-4f65-8969-5bcdfeb4a5ad" released by "delete_volume" :: held 1.048s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Created reservations ['7ac7f974-3f11-4b17-84a3-3c24e580cedc', 'd0411766-2bb1-47cd-aeab-e7694f3a8285', 'dca633d5-5d30-4cb1-b114-11d3fa13d282', 'ccdd7497-6c0d-407a-a2e0-e9050a385b94'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:25 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 1G" returned: 0 in 0.532s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Downloaded image 7d19764d-5130-466b-8d21-7ec20fb6999d ((None, [{'url': 'file:///opt/stack/data/glance/images/7d19764d-5130-466b-8d21-7ec20fb6999d', 'metadata': {}}])) to volume 7d6cde31-24ca-4e80-9d22-9c4a81a4f247 successfully. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Temporary image 7d19764d-5130-466b-8d21-7ec20fb6999d for user 8ae287150244493f96691eb57bf7bfb6 is deleted. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Marking volume 7d6cde31-24ca-4e80-9d22-9c4a81a4f247 as bootable. {{(pid=86812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Copying metadata from image 7d19764d-5130-466b-8d21-7ec20fb6999d to 7d6cde31-24ca-4e80-9d22-9c4a81a4f247. {{(pid=86812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Creating volume glance metadata for volume 7d6cde31-24ca-4e80-9d22-9c4a81a4f247 backed by image 7d19764d-5130-466b-8d21-7ec20fb6999d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7d19764d-5130-466b-8d21-7ec20fb6999d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cd8ccbc9c8d4259b42a67bfb5daf174f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:40:25 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d 1073741824" returned: 0 in 0.623s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:25 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:25 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:25 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d Nov 01 12:40:25 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7efb09fe-24bc-43a3-b282-85eb3a55e197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247', 'volume_size': 1, 'image_id': '7d19764d-5130-466b-8d21-7ec20fb6999d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d19764d-5130-466b-8d21-7ec20fb6999d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd8ccbc9c8d4259b42a67bfb5daf174f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b0f0f626ecbd496da35c86ac365e2d7c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4811ea7308cc13ca54a9bc5ea8092c12bf7f37dfcfbfb8391b32a4d5a02ab09461a8884212f7b124670d160b6453a5900cc5c24c853a153cc6ee9e448e808fb0', 'id': '7d19764d-5130-466b-8d21-7ec20fb6999d', 'created_at': datetime.datetime(2026, 11, 1, 11, 40, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 40, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d19764d-5130-466b-8d21-7ec20fb6999d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b23e50-c357-40d5-ad80-0db892119a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Volume volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 (7d6cde31-24ca-4e80-9d22-9c4a81a4f247): created successfully Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b23e50-c357-40d5-ad80-0db892119a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Flow 'volume_create_manager' (dcb4c42e-df36-4dbf-9d31-d1c0c0ccc3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-17684b56-2c76-41fe-99b3-198bb76fc757 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Created volume successfully. Nov 01 12:40:25 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.300s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Deleted volume successfully. Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e9b09582-a4fc-4170-9cb6-435a8640692c tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-7a42c211-9778-4f65-8969-5bcdfeb4a5ad-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:25 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d" returned: 0 in 0.311s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-831243619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2460777-0ed5-4819-b4da-6e9746047059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:25Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Creating volume f2460777-0ed5-4819-b4da-6e9746047059 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:25 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace9f856-6599-482e-b08c-efd401fd987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059 1073741824 Nov 01 12:40:25 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b0425a-e19b-4097-ac45-99c475bc0e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d (8fe8acbd-92b0-4a7b-a593-ee3a321c496d): created successfully Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b0425a-e19b-4097-ac45-99c475bc0e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (f282ceb9-d8ad-457a-82c5-6715b48357e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-30f25772-c5cc-4ab4-a58c-510809ede189 tempest-CreateVolumesFromSnapshotTest-991106065 None] Created volume successfully. Nov 01 12:40:26 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059 1073741824" returned: 0 in 0.491s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:26 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059 Nov 01 12:40:26 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Acquiring lock "cinder-7d6cde31-24ca-4e80-9d22-9c4a81a4f247-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "cinder-315998dd-fa87-43f4-8fb0-633b9fdda6f7-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Lock "cinder-7d6cde31-24ca-4e80-9d22-9c4a81a4f247-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-315998dd-fa87-43f4-8fb0-633b9fdda6f7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Acquiring lock "cinder-quobyte-7d6cde31-24ca-4e80-9d22-9c4a81a4f247" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "cinder-quobyte-315998dd-fa87-43f4-8fb0-633b9fdda6f7" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Lock "cinder-quobyte-7d6cde31-24ca-4e80-9d22-9c4a81a4f247" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-quobyte-315998dd-fa87-43f4-8fb0-633b9fdda6f7" acquired by "delete_volume" :: waited 0.039s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c921c9fc-da93-4311-85b1-f80f0c1c4d2a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de8d0dd-2791-4327-9063-6ceb538b61c9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:26 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059" returned: 0 in 0.362s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.477s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1375498214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621bed03-6aed-4a3b-8cf3-bf3a65e6803b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287239941186427b8a3a90150cc63dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:25Z,use_quota=True,user_id='9a29d3d4370b4479bd52cd7cb6b5a021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Creating volume 621bed03-6aed-4a3b-8cf3-bf3a65e6803b {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:26 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:26 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 Nov 01 12:40:26 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e878918a-57be-497b-81ed-9196fa08b539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2460777-0ed5-4819-b4da-6e9746047059', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:26 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7 Nov 01 12:40:26 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:26 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b 1073741824 Nov 01 12:40:26 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771a955b-b27d-448e-9dde-817cf7d2ad65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:26 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume volume-f2460777-0ed5-4819-b4da-6e9746047059 (f2460777-0ed5-4819-b4da-6e9746047059): created successfully Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771a955b-b27d-448e-9dde-817cf7d2ad65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (e74bb39a-9338-4063-b68c-cbabe882e5aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:26 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5e024acb-8535-41cf-9fc4-d9030e324f91 tempest-CreateVolumesFromSnapshotTest-991106065 None] Created volume successfully. Nov 01 12:40:27 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247" returned: 0 in 0.446s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:27 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247 Nov 01 12:40:27 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:27 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7" returned: 0 in 0.543s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:27 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7 Nov 01 12:40:27 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:27 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7d6cde31-24ca-4e80-9d22-9c4a81a4f247" returned: 0 in 0.307s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Lock "cinder-quobyte-7d6cde31-24ca-4e80-9d22-9c4a81a4f247" released by "delete_volume" :: held 0.827s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:27 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b 1073741824" returned: 0 in 0.697s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Created reservations ['f8ecb4cd-a08d-486c-a51f-59f982c63a30', '4168631d-4c67-433e-bba6-297c2d3b2482', 'c9af41d0-78e0-440b-9bd9-77357b2ead9c', '10ef9314-f028-4792-ae23-f4104c796f87'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:27 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-315998dd-fa87-43f4-8fb0-633b9fdda6f7" returned: 0 in 0.334s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:27 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b Nov 01 12:40:27 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-quobyte-315998dd-fa87-43f4-8fb0-633b9fdda6f7" released by "delete_volume" :: held 0.978s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:27 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:27 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Created reservations ['09421229-09a7-4e06-b88c-e065391cbfd9', 'afeeae4a-46a7-4703-bee1-48b804fbbe5b', 'c942a31c-00bf-4268-bfa6-aba4d35e8949', '78b0c142-5fad-425b-a953-f8c96ad38d9d'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:27 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b" returned: 0 in 0.402s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:27 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:27 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ee8e44-257d-40b8-a595-08fc49010c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cd8ee6-f38b-499d-96be-0a4d6db4498f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:27 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.336s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:27 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Volume volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b (621bed03-6aed-4a3b-8cf3-bf3a65e6803b): created successfully Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cd8ee6-f38b-499d-96be-0a4d6db4498f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Flow 'volume_create_manager' (dc7b993f-a420-45fb-af6d-028a52352624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Deleted volume successfully. Nov 01 12:40:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e7e0c9b6-7504-4c63-a382-c53c67bd0a40 tempest-CreateVolumesFromSnapshotTest-991106065 None] Created volume successfully. Nov 01 12:40:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-355015da-952d-40a4-b0b6-4eb0561f1749 tempest-VolumeAndVolumeTypeFromImageTest-733148146 None] Lock "cinder-7d6cde31-24ca-4e80-9d22-9c4a81a4f247-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:28 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.339s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:28 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Deleted volume successfully. Nov 01 12:40:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-07ee52c9-045c-458b-8d1a-46dbfeebf2f0 tempest-CreateVolumesFromImageTest-1889538050 None] Lock "cinder-315998dd-fa87-43f4-8fb0-633b9fdda6f7-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-f2460777-0ed5-4819-b4da-6e9746047059-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-f2460777-0ed5-4819-b4da-6e9746047059-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-quobyte-f2460777-0ed5-4819-b4da-6e9746047059" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-f2460777-0ed5-4819-b4da-6e9746047059" acquired by "delete_volume" :: waited 0.026s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef945c9-b9db-4477-a130-cb792c2a4ebd]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:29 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059 Nov 01 12:40:29 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:29 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059" returned: 0 in 0.461s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:29 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059 Nov 01 12:40:29 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:30 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-f2460777-0ed5-4819-b4da-6e9746047059" returned: 0 in 0.359s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-f2460777-0ed5-4819-b4da-6e9746047059" released by "delete_volume" :: held 0.893s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Created reservations ['7f86bb3e-f59b-4d67-87a1-2be4cd130f22', '260941cf-656b-4662-972f-673496771730', '45848528-ba2d-47aa-8a2d-43b181c37773', 'c9171351-435b-4e56-89f2-235fffd9ffc0'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:30 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:30 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:30 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.304s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:30 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Deleted volume successfully. Nov 01 12:40:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d35a2815-95ec-4d3b-b429-d9130e39f197 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-f2460777-0ed5-4819-b4da-6e9746047059-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-621bed03-6aed-4a3b-8cf3-bf3a65e6803b-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-621bed03-6aed-4a3b-8cf3-bf3a65e6803b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-quobyte-621bed03-6aed-4a3b-8cf3-bf3a65e6803b" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-621bed03-6aed-4a3b-8cf3-bf3a65e6803b" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:31 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[153eae3e-dc32-4dcb-9690-f5cd27f4ebc7]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:31 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b Nov 01 12:40:31 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:32 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b" returned: 0 in 0.429s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:32 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b Nov 01 12:40:32 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:32 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-621bed03-6aed-4a3b-8cf3-bf3a65e6803b" returned: 0 in 0.318s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-621bed03-6aed-4a3b-8cf3-bf3a65e6803b" released by "delete_volume" :: held 0.799s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Created reservations ['de85e53b-0758-4566-babd-d9b831fcecfb', '6e4f0871-f94c-4cf2-a7af-77a85e8cf17f', 'c1e1406f-7b40-43d6-bae0-7a534ea3988d', '4dcec715-099f-4df2-acba-0a95cf66d293'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:32 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:32 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-8fe8acbd-92b0-4a7b-a593-ee3a321c496d-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-8fe8acbd-92b0-4a7b-a593-ee3a321c496d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:32 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-quobyte-8fe8acbd-92b0-4a7b-a593-ee3a321c496d" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.431s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:32 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Deleted volume successfully. Nov 01 12:40:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-8fe8acbd-92b0-4a7b-a593-ee3a321c496d" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-155a1d90-3b8e-40b9-a655-53bfa0f25fe9 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-621bed03-6aed-4a3b-8cf3-bf3a65e6803b-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a675249-e302-4a84-a2a6-ca3551b29d97]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:33 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d Nov 01 12:40:33 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (759ebed5-52e3-4935-8d25-6d06ad742a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac81659-0d1e-4f96-a8e6-8618a5e74693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac81659-0d1e-4f96-a8e6-8618a5e74693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1273754292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5c8820-5bfb-42ab-b2bc-e8f752c9223e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:33Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97b318d-4bc1-44d1-a39a-d944d169f68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97b318d-4bc1-44d1-a39a-d944d169f68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e40079-ed98-40aa-81f3-ea50f9b04adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e40079-ed98-40aa-81f3-ea50f9b04adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5c8820-5bfb-42ab-b2bc-e8f752c9223e', 'volume_name': 'volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b641e78-de7c-4784-917c-5100aa21d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b641e78-de7c-4784-917c-5100aa21d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24e2b20-d7df-4298-be0f-316feac674a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:33 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume ee5c8820-5bfb-42ab-b2bc-e8f752c9223e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e', 'volume_size': 1} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1273754292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee5c8820-5bfb-42ab-b2bc-e8f752c9223e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:33Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Creating volume ee5c8820-5bfb-42ab-b2bc-e8f752c9223e {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:33 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:33 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e 1073741824 Nov 01 12:40:33 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:33 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d" returned: 0 in 0.431s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:33 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d Nov 01 12:40:33 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:33 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-8fe8acbd-92b0-4a7b-a593-ee3a321c496d" returned: 0 in 0.302s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-8fe8acbd-92b0-4a7b-a593-ee3a321c496d" released by "delete_volume" :: held 0.814s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Created reservations ['ebdc7c86-deb7-4321-992d-a0f13097a93b', '4ec72e71-0b85-4ece-a35d-7608fdc12202', '91ae185b-b44f-4935-830d-aec9bdcf2cad', 'ad4b5eb1-c940-45be-a3d8-3aa78f502b69'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:33 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e 1073741824" returned: 0 in 0.583s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:34 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:34 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:34 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e Nov 01 12:40:34 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-d03a181f-ba61-4f72-a855-872bfc0f809f-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-d03a181f-ba61-4f72-a855-872bfc0f809f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-quobyte-d03a181f-ba61-4f72-a855-872bfc0f809f" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-d03a181f-ba61-4f72-a855-872bfc0f809f" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bab525-4a66-4558-826c-5a023d46cf57]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:34 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e" returned: 0 in 0.410s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:34 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.488s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:34 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Deleted volume successfully. Nov 01 12:40:34 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f Nov 01 12:40:34 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24e2b20-d7df-4298-be0f-316feac674a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7666b8cc-c6ea-4ada-9ef9-f7b8a2eba60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-04d8269b-166d-43ac-aadb-cc6d8d01531e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-8fe8acbd-92b0-4a7b-a593-ee3a321c496d-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:34 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e (ee5c8820-5bfb-42ab-b2bc-e8f752c9223e): created successfully Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7666b8cc-c6ea-4ada-9ef9-f7b8a2eba60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (759ebed5-52e3-4935-8d25-6d06ad742a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:34 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9a4cf127-a2c7-40a5-aacd-f26876ad82b9 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created volume successfully. Nov 01 12:40:34 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f" returned: 0 in 0.478s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:34 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f Nov 01 12:40:34 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:35 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d03a181f-ba61-4f72-a855-872bfc0f809f" returned: 0 in 0.300s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-d03a181f-ba61-4f72-a855-872bfc0f809f" released by "delete_volume" :: held 0.856s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Created reservations ['3c390c3a-2caf-4bb3-a33b-226eab3cea07', '004759b0-3dae-44a3-8313-d141df880b1c', '6a0e19f8-5bc0-4b96-bbd1-e367d5cdc22f', 'f843f024-6bf0-47cf-9003-39c22f9a9b03'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:35 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:35 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-075823c3-a94b-4c08-a05a-2b29f8a1ffb0-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-075823c3-a94b-4c08-a05a-2b29f8a1ffb0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-quobyte-075823c3-a94b-4c08-a05a-2b29f8a1ffb0" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-075823c3-a94b-4c08-a05a-2b29f8a1ffb0" acquired by "delete_volume" :: waited 0.034s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:35 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[608f3c4c-be4d-4db8-abba-309a18849508]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.323s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Deleted volume successfully. Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-bbcd428a-da70-4955-8dca-7148b7d48cf5 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-d03a181f-ba61-4f72-a855-872bfc0f809f-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:35 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0 Nov 01 12:40:35 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Flow 'volume_create_manager' (116fbe0b-97aa-4a6d-bc56-234aa6235b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856934cc-0419-443f-87e8-6ad40a2af774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856934cc-0419-443f-87e8-6ad40a2af774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0284942c-daa8-4712-a4f1-e5ea2023a871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd242ff4076473194eec063c75c66d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:36Z,use_quota=True,user_id='91353357905f469a924b2c3a5051e47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa3eb26-8a02-495b-898b-a4def912b304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa3eb26-8a02-495b-898b-a4def912b304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c8b876-75f1-40bc-9a28-dfad0716bd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:35 devstack cinder-volume[86812]: DEBUG cinder.image.glance [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Creating Keystone auth plugin from conf {{(pid=86812) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:40:36 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0" returned: 0 in 0.492s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:36 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0 Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:36 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (6bee426b-c382-4026-a31f-b3fe1434bd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e8d807-ab91-4ff7-9824-992c57ee4673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e8d807-ab91-4ff7-9824-992c57ee4673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-783606012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9c673c-5e07-4736-905c-0b5c06b9e0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:36Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1783ea4f-1eae-4936-9740-ea89fcf849e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1783ea4f-1eae-4936-9740-ea89fcf849e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01cf9b9-8132-4a77-810b-2ce08ca74506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b01cf9b9-8132-4a77-810b-2ce08ca74506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9c673c-5e07-4736-905c-0b5c06b9e0b6', 'volume_name': 'volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8060c2e3-a65b-4c2f-a8a8-58bfb140f2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8060c2e3-a65b-4c2f-a8a8-58bfb140f2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cdf25d-6bc8-44c8-9c8d-3cfb30fbee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume 7b9c673c-5e07-4736-905c-0b5c06b9e0b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6', 'volume_size': 1} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-783606012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9c673c-5e07-4736-905c-0b5c06b9e0b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:36Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Creating volume 7b9c673c-5e07-4736-905c-0b5c06b9e0b6 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:36 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:36 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6 1073741824 Nov 01 12:40:36 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:36 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-075823c3-a94b-4c08-a05a-2b29f8a1ffb0" returned: 0 in 0.377s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-075823c3-a94b-4c08-a05a-2b29f8a1ffb0" released by "delete_volume" :: held 0.963s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Created reservations ['c610ac4b-4a2c-4d66-bdac-eb38c45464c5', 'bbff6050-e2b9-4d46-b31a-1b0a81a9df9c', 'e062b402-8bfe-479a-b428-4cb2b657fd6d', 'b3459505-b1a6-4506-bf25-85380b2b6db5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c8b876-75f1-40bc-9a28-dfad0716bd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0284942c-daa8-4712-a4f1-e5ea2023a871', 'volume_name': 'volume-0284942c-daa8-4712-a4f1-e5ea2023a871', 'volume_size': 1, 'image_id': '8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f5f036d2eaf883d42bfa09571b8a7b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'abd242ff4076473194eec063c75c66d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f66685e16ced8ad5635b90078fdb650a5a3229f5da4a4c7785bb9d0b582f5216a4ffb3e8d5cda1873d03873ba90c69ffee30770b11c284f4fc81fade02736435', 'id': '8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'created_at': datetime.datetime(2026, 11, 1, 11, 40, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 40, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f3e3818-434c-4ee6-8608-d0ba1c3325eb/file', 'properties': {}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0aad78-8ddc-42b0-a9c3-84cb014a7f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0aad78-8ddc-42b0-a9c3-84cb014a7f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e710ab90-453a-42e1-9f2b-195c661baf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Volume 0284942c-daa8-4712-a4f1-e5ea2023a871: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0284942c-daa8-4712-a4f1-e5ea2023a871', 'volume_size': 1, 'image_id': '8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f5f036d2eaf883d42bfa09571b8a7b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'abd242ff4076473194eec063c75c66d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f66685e16ced8ad5635b90078fdb650a5a3229f5da4a4c7785bb9d0b582f5216a4ffb3e8d5cda1873d03873ba90c69ffee30770b11c284f4fc81fade02736435', 'id': '8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'created_at': datetime.datetime(2026, 11, 1, 11, 40, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 40, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f3e3818-434c-4ee6-8608-d0ba1c3325eb/file', 'properties': {}}, 'image_service': } Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Trying to clone 0284942c-daa8-4712-a4f1-e5ea2023a871 from image 8f3e3818-434c-4ee6-8608-d0ba1c3325eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'metadata': {}}]). {{(pid=86812) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (961b1c88-608e-471e-ac5c-697691412543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8c7823-b82f-49c4-994c-9aa68f2b1a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8c7823-b82f-49c4-994c-9aa68f2b1a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-905705410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7302f99f-f9c5-482d-9f0c-bc5d984965c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:37Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63164af-c519-4081-ae1e-8bbf1baa94e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63164af-c519-4081-ae1e-8bbf1baa94e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b4f66a-46c8-4417-91bc-193119ea8219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b4f66a-46c8-4417-91bc-193119ea8219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7302f99f-f9c5-482d-9f0c-bc5d984965c9', 'volume_name': 'volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cf4c1e-063f-40cc-94b2-543fcd92085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39cf4c1e-063f-40cc-94b2-543fcd92085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296dc931-15f8-44f9-a9ba-1a3a9f96f891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:36 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume 7302f99f-f9c5-482d-9f0c-bc5d984965c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9', 'volume_size': 1} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:36 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:40:37 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Image download 0.00 MB at 0.00 MB/s Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6 1073741824" returned: 0 in 0.764s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:36 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:37 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:37 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:37 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6522bae-4297-45cf-9488-dd8623fa6973]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:37 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:37 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6 Nov 01 12:40:37 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.360s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:37 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.491s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 28 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:40:37 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD Nov 01 12:40:37 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:37 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Deleted volume successfully. Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-0c5ba501-298e-4c5e-b934-c85c694d7dcb tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-075823c3-a94b-4c08-a05a-2b29f8a1ffb0-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (278aecbf-ab60-4f03-a383-338c2d088e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f37971-5f7c-4d03-9154-e60b9dbe5ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6" returned: 0 in 0.399s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:37 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.843s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-905705410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7302f99f-f9c5-482d-9f0c-bc5d984965c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:37Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Creating volume 7302f99f-f9c5-482d-9f0c-bc5d984965c9 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:37 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f37971-5f7c-4d03-9154-e60b9dbe5ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2014988785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0234c930-e4c7-4c1e-8caf-1841da116dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:38Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:37 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9 1073741824 Nov 01 12:40:37 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7312544-02c2-498d-bab3-d61f70a83799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7312544-02c2-498d-bab3-d61f70a83799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ae47d6-dafb-4023-bd26-645ff804df62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:37 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ae47d6-dafb-4023-bd26-645ff804df62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0234c930-e4c7-4c1e-8caf-1841da116dcb', 'volume_name': 'volume-0234c930-e4c7-4c1e-8caf-1841da116dcb', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41097f35-d1ac-4ccb-81f8-89576ec1256e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41097f35-d1ac-4ccb-81f8-89576ec1256e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca3203e-8d8d-44f2-bdbd-1173e71aca37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:37 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume 0234c930-e4c7-4c1e-8caf-1841da116dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0234c930-e4c7-4c1e-8caf-1841da116dcb', 'volume_size': 1} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-bc1b6205-4044-4bf9-85fe-e1a05832e91d-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD" returned: 0 in 0.717s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cdf25d-6bc8-44c8-9c8d-3cfb30fbee97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accac0ad-9b2f-405c-9559-227671d325ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-bc1b6205-4044-4bf9-85fe-e1a05832e91d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-quobyte-d4f80708-e71b-4b94-a432-9d2eb65f87c7" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-d4f80708-e71b-4b94-a432-9d2eb65f87c7" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-quobyte-bc1b6205-4044-4bf9-85fe-e1a05832e91d" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:38 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6 (7b9c673c-5e07-4736-905c-0b5c06b9e0b6): created successfully Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accac0ad-9b2f-405c-9559-227671d325ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (6bee426b-c382-4026-a31f-b3fe1434bd56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-bc1b6205-4044-4bf9-85fe-e1a05832e91d" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Deleting offline snapshot bc1b6205-4044-4bf9-85fe-e1a05832e91d of volume d4f80708-e71b-4b94-a432-9d2eb65f87c7 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] snapshot_file for this snap is: volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:40:38 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c3115c23-955e-4469-a989-8330b1c2f1f4 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created volume successfully. Nov 01 12:40:38 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD Nov 01 12:40:38 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8cfb5c-c273-447a-9af8-701bf904893f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (30827057-ed94-475f-8e1d-dd2489e0077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a7d972-37b4-45b9-9925-425a4c0e466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:38 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d Nov 01 12:40:38 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a7d972-37b4-45b9-9925-425a4c0e466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215553861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baff28d9-28da-4a2c-91f7-9af8bcd91228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:38Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23f92c3-394f-453d-a348-6d49c375880d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a23f92c3-394f-453d-a348-6d49c375880d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864cd374-20ef-44c9-932d-b55c1fd46aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (864cd374-20ef-44c9-932d-b55c1fd46aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baff28d9-28da-4a2c-91f7-9af8bcd91228', 'volume_name': 'volume-baff28d9-28da-4a2c-91f7-9af8bcd91228', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350d6471-bebb-409c-b5df-a321585d8579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350d6471-bebb-409c-b5df-a321585d8579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee722ad4-9dc3-4d0b-b91b-640b003f4b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:38 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume baff28d9-28da-4a2c-91f7-9af8bcd91228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baff28d9-28da-4a2c-91f7-9af8bcd91228', 'volume_size': 1} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:38 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9 1073741824" returned: 0 in 0.716s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:38 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD" returned: 1 in 0.564s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Temporary image 8f3e3818-434c-4ee6-8608-d0ba1c3325eb is fetched for user 91353357905f469a924b2c3a5051e47c. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:38 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9 Nov 01 12:40:38 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a78f0a-baca-4ee3-a344-2f0e7da288b1]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:38 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d" returned: 0 in 0.630s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:40:38 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD Nov 01 12:40:38 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (f4b06e2a-d169-4ea7-a1ad-135c4380666b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff647eaf-d207-43f3-b512-3bfd41481bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac6dcaf-ab8c-4c0b-a13e-e2ee3f77bf6f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff647eaf-d207-43f3-b512-3bfd41481bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1580518624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02369887-cc68-4814-b43e-873e2affb25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:39Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:38 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b27b95c-29f0-427d-adf3-3a110874ffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b27b95c-29f0-427d-adf3-3a110874ffeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95256ff-aa37-40e3-8324-df22fef3835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95256ff-aa37-40e3-8324-df22fef3835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02369887-cc68-4814-b43e-873e2affb25a', 'volume_name': 'volume-02369887-cc68-4814-b43e-873e2affb25a', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8f14f4-c2d7-4248-b45f-662c1960c905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d8f14f4-c2d7-4248-b45f-662c1960c905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2597d963-7d80-4b1d-ae87-2afa15388f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:38 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume 02369887-cc68-4814-b43e-873e2affb25a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02369887-cc68-4814-b43e-873e2affb25a', 'volume_size': 1} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9" returned: 0 in 0.420s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.039s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2014988785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0234c930-e4c7-4c1e-8caf-1841da116dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:38Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Creating volume 0234c930-e4c7-4c1e-8caf-1841da116dcb {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:38 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296dc931-15f8-44f9-a9ba-1a3a9f96f891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:39 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb 1073741824 Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9fd87cb-44a0-4776-820b-a200b55b3416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:39 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:39 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 Nov 01 12:40:39 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:39 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9 (7302f99f-f9c5-482d-9f0c-bc5d984965c9): created successfully Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9fd87cb-44a0-4776-820b-a200b55b3416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (961b1c88-608e-471e-ac5c-697691412543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ba0b01ca-06e8-498c-a736-d552b783cfb5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created volume successfully. Nov 01 12:40:39 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:39 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD Nov 01 12:40:39 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:39 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7" returned: 0 in 0.504s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:39 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d Nov 01 12:40:39 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:39 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD" returned: 1 in 0.382s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:39 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb 1073741824" returned: 0 in 0.587s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:39 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb Nov 01 12:40:39 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:39 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d" returned: 0 in 0.445s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:39 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d Nov 01 12:40:39 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:39 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb" returned: 0 in 0.279s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.505s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215553861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baff28d9-28da-4a2c-91f7-9af8bcd91228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:38Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Creating volume baff28d9-28da-4a2c-91f7-9af8bcd91228 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:39 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aca3203e-8d8d-44f2-bdbd-1173e71aca37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0234c930-e4c7-4c1e-8caf-1841da116dcb', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:39 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228 1073741824 Nov 01 12:40:39 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32822b64-ebe1-49f0-bac7-c2e605063ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:39 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume volume-0234c930-e4c7-4c1e-8caf-1841da116dcb (0234c930-e4c7-4c1e-8caf-1841da116dcb): created successfully Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32822b64-ebe1-49f0-bac7-c2e605063ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:39 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (278aecbf-ab60-4f03-a383-338c2d088e59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:39 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f640dbce-7d59-465e-b926-8be7a5987493 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created volume successfully. Nov 01 12:40:40 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7.bc1b6205-4044-4bf9-85fe-e1a05832e91d" returned: 0 in 0.311s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-bc1b6205-4044-4bf9-85fe-e1a05832e91d" released by "_delete_snapshot" :: held 2.094s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-d4f80708-e71b-4b94-a432-9d2eb65f87c7" released by "delete_snapshot" :: held 2.156s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Created reservations ['e4fb9bc3-a765-4063-b96b-d1422e10ff89', '7453f8e0-4ad0-4f47-b4a0-7d5fb8d820c2', '5832e172-bff6-4f2f-a0f9-9160c87bf131', '52fffa2d-ecfc-4467-bc3f-d804a0370fe2'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:40 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Delete snapshot completed successfully. Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8eac21ba-14f0-433b-b7e2-d16e4c4f0221 tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-bc1b6205-4044-4bf9-85fe-e1a05832e91d-delete_snapshot" released by "delete_snapshot" :: held 2.351s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:40 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228 1073741824" returned: 0 in 0.567s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:40 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228 Nov 01 12:40:40 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:40 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228" returned: 0 in 0.254s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.820s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1580518624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02369887-cc68-4814-b43e-873e2affb25a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='364bc579e50b4d508643a9fa7630691a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:39Z,use_quota=True,user_id='aad364f9d72c42a09c168e811a2740ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Creating volume 02369887-cc68-4814-b43e-873e2affb25a {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:40 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee722ad4-9dc3-4d0b-b91b-640b003f4b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baff28d9-28da-4a2c-91f7-9af8bcd91228', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:40 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a 1073741824 Nov 01 12:40:40 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb52ef0-74fa-4c22-85b8-19f6cc8d3609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:40 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume volume-baff28d9-28da-4a2c-91f7-9af8bcd91228 (baff28d9-28da-4a2c-91f7-9af8bcd91228): created successfully Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb52ef0-74fa-4c22-85b8-19f6cc8d3609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (30827057-ed94-475f-8e1d-dd2489e0077a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:40 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4f5bc18f-6438-4862-a449-a7f24c521f49 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created volume successfully. Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-d4f80708-e71b-4b94-a432-9d2eb65f87c7-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-d4f80708-e71b-4b94-a432-9d2eb65f87c7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "cinder-quobyte-d4f80708-e71b-4b94-a432-9d2eb65f87c7" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-d4f80708-e71b-4b94-a432-9d2eb65f87c7" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f8d666-dcca-41d2-98e3-d3ab362ec36c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:41 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a 1073741824" returned: 0 in 0.554s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:41 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 Nov 01 12:40:41 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:41 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a Nov 01 12:40:41 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:41 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a" returned: 0 in 0.267s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.145s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0284942c-daa8-4712-a4f1-e5ea2023a871,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abd242ff4076473194eec063c75c66d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:36Z,use_quota=True,user_id='91353357905f469a924b2c3a5051e47c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Creating volume 0284942c-daa8-4712-a4f1-e5ea2023a871 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:41 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:41 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7" returned: 0 in 0.399s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:41 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 1073741824 Nov 01 12:40:41 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2597d963-7d80-4b1d-ae87-2afa15388f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02369887-cc68-4814-b43e-873e2affb25a', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5972714-f8ab-4abf-ac22-9c16324a0aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:41 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7 Nov 01 12:40:41 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:41 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Volume volume-02369887-cc68-4814-b43e-873e2affb25a (02369887-cc68-4814-b43e-873e2affb25a): created successfully Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5972714-f8ab-4abf-ac22-9c16324a0aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Flow 'volume_create_manager' (f4b06e2a-d169-4ea7-a1ad-135c4380666b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:41 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5dcc98b7-7e88-4b04-8ea5-7d55ee1bc6c5 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created volume successfully. Nov 01 12:40:41 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d4f80708-e71b-4b94-a432-9d2eb65f87c7" returned: 0 in 0.297s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:41 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-quobyte-d4f80708-e71b-4b94-a432-9d2eb65f87c7" released by "delete_volume" :: held 0.775s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Created reservations ['d19fd3c0-9c3b-44c2-9d12-27f063b67009', 'de7431cf-ac6e-455a-9b70-1cc94d2c1002', '27dfab63-9a9f-4fc5-932b-4875370a8288', '37c0be18-ad1d-4941-8aa2-17717acecdd0'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:42 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:42 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:42 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 1073741824" returned: 0 in 0.554s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Flow 'volume_create_manager' (af9184e7-1f85-4bf9-97d4-c4581037e12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3cf762-246c-4348-9391-e4ec8b49fe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-02369887-cc68-4814-b43e-873e2affb25a-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3cf762-246c-4348-9391-e4ec8b49fe00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607787504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f145d94-33a1-4f8e-8fa3-644746dd852b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db824634389d4664a71c293c4faaae39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:42Z,use_quota=True,user_id='ccd0a1efeadd450f93d49e66f7ce8980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4be0e5-7a2e-4d85-9102-79627998532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4be0e5-7a2e-4d85-9102-79627998532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a181301-8717-4318-896b-4448cc4eafda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a181301-8717-4318-896b-4448cc4eafda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f145d94-33a1-4f8e-8fa3-644746dd852b', 'volume_name': 'volume-5f145d94-33a1-4f8e-8fa3-644746dd852b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c90da90-5e43-4f72-8d5d-c80d0bc23104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c90da90-5e43-4f72-8d5d-c80d0bc23104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be7fa38-1856-4f8d-a807-3e633cc83f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:42 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Volume 5f145d94-33a1-4f8e-8fa3-644746dd852b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f145d94-33a1-4f8e-8fa3-644746dd852b', 'volume_size': 1} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-02369887-cc68-4814-b43e-873e2affb25a-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:42 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 Nov 01 12:40:42 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-quobyte-02369887-cc68-4814-b43e-873e2affb25a" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-02369887-cc68-4814-b43e-873e2affb25a" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:42 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5b0830-1dcb-4c14-adf3-15ae1e753302]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.316s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Deleted volume successfully. Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3a73ca23-7d12-48ed-b8a8-4458ac1cc86e tempest-CreateVolumesFromSnapshotTest-991106065 None] Lock "cinder-d4f80708-e71b-4b94-a432-9d2eb65f87c7-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:42 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a Nov 01 12:40:42 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:42 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871" returned: 0 in 0.312s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607787504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f145d94-33a1-4f8e-8fa3-644746dd852b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db824634389d4664a71c293c4faaae39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:42Z,use_quota=True,user_id='ccd0a1efeadd450f93d49e66f7ce8980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Creating volume 5f145d94-33a1-4f8e-8fa3-644746dd852b {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:42 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:42 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b 1073741824 Nov 01 12:40:42 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Attempting download of 8f3e3818-434c-4ee6-8608-d0ba1c3325eb ((None, [{'url': 'file:///opt/stack/data/glance/images/8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'metadata': {}}])) to volume 0284942c-daa8-4712-a4f1-e5ea2023a871. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a56371-b351-481a-88f8-d48cecd33370]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_w661vh9o {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:42 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a" returned: 0 in 0.452s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:42 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_w661vh9o Nov 01 12:40:42 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:42 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a Nov 01 12:40:42 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:43 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b 1073741824" returned: 0 in 0.564s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:43 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_w661vh9o" returned: 0 in 0.471s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_w661vh9o {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:43 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-02369887-cc68-4814-b43e-873e2affb25a" returned: 0 in 0.406s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:43 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b Nov 01 12:40:43 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-02369887-cc68-4814-b43e-873e2affb25a" released by "delete_volume" :: held 0.919s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:43 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_w661vh9o Nov 01 12:40:43 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created reservations ['e490f673-7d4c-47bf-9664-2a797e191ad1', 'c94a8293-4694-4894-ba89-2f2619c5f6b6', '1b3210aa-27d5-4ba6-a786-cf5d5a425ad5', '0e68505b-2785-4293-b1b7-62c885435e02'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:43 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:43 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:43 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_w661vh9o" returned: 1 in 0.399s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_w661vh9o' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[08375147-8953-445e-a135-7d709b427497]: (4, 'raw') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:43 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b" returned: 0 in 0.392s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be7fa38-1856-4f8d-a807-3e633cc83f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f145d94-33a1-4f8e-8fa3-644746dd852b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c1813e-a147-4d09-9a8c-f58ec0d41451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:43 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Volume volume-5f145d94-33a1-4f8e-8fa3-644746dd852b (5f145d94-33a1-4f8e-8fa3-644746dd852b): created successfully Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c1813e-a147-4d09-9a8c-f58ec0d41451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Flow 'volume_create_manager' (af9184e7-1f85-4bf9-97d4-c4581037e12a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-00488578-9e46-4db6-854b-edbd5b61fd01 tempest-ProjectReaderTests-1711193897 None] Created volume successfully. Nov 01 12:40:43 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD Nov 01 12:40:43 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:43 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.301s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Deleted volume successfully. Nov 01 12:40:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-284a3a0b-2881-4ee6-820d-b2e9b082b0a8 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-02369887-cc68-4814-b43e-873e2affb25a-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:44 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:44 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD Nov 01 12:40:44 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:44 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD" returned: 1 in 0.345s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD' failed. Not Retrying. {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] 8f3e3818-434c-4ee6-8608-d0ba1c3325eb was raw, converting to qcow2 {{(pid=86812) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:44 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 Nov 01 12:40:44 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-baff28d9-28da-4a2c-91f7-9af8bcd91228-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-baff28d9-28da-4a2c-91f7-9af8bcd91228-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-quobyte-baff28d9-28da-4a2c-91f7-9af8bcd91228" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-baff28d9-28da-4a2c-91f7-9af8bcd91228" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db2a902-ded7-45f5-acfc-7ce68cce8243]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Acquiring lock "cinder-5f145d94-33a1-4f8e-8fa3-644746dd852b-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Lock "cinder-5f145d94-33a1-4f8e-8fa3-644746dd852b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:44 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228 Nov 01 12:40:44 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:44 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871" returned: 0 in 0.575s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8f3e3818-434c-4ee6-8608-d0ba1c3325eb_j35ruo51devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:40:44 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Acquiring lock "cinder-quobyte-5f145d94-33a1-4f8e-8fa3-644746dd852b" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:45 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 1G Nov 01 12:40:45 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Lock "cinder-quobyte-5f145d94-33a1-4f8e-8fa3-644746dd852b" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[053fdaa9-c84d-4383-8d7a-e4df216e7dd4]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:45 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b Nov 01 12:40:45 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:45 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228" returned: 0 in 0.490s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:45 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228 Nov 01 12:40:45 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:45 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 1G" returned: 0 in 0.369s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Downloaded image 8f3e3818-434c-4ee6-8608-d0ba1c3325eb ((None, [{'url': 'file:///opt/stack/data/glance/images/8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'metadata': {}}])) to volume 0284942c-daa8-4712-a4f1-e5ea2023a871 successfully. {{(pid=86812) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Temporary image 8f3e3818-434c-4ee6-8608-d0ba1c3325eb for user 91353357905f469a924b2c3a5051e47c is deleted. {{(pid=86812) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.volume_utils [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Marking volume 0284942c-daa8-4712-a4f1-e5ea2023a871 as bootable. {{(pid=86812) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Copying metadata from image 8f3e3818-434c-4ee6-8608-d0ba1c3325eb to 0284942c-daa8-4712-a4f1-e5ea2023a871. {{(pid=86812) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Creating volume glance metadata for volume 0284942c-daa8-4712-a4f1-e5ea2023a871 backed by image 8f3e3818-434c-4ee6-8608-d0ba1c3325eb with: {'image_id': '8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4f5f036d2eaf883d42bfa09571b8a7b4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86812) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e710ab90-453a-42e1-9f2b-195c661baf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0284942c-daa8-4712-a4f1-e5ea2023a871', 'volume_size': 1, 'image_id': '8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f5f036d2eaf883d42bfa09571b8a7b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'abd242ff4076473194eec063c75c66d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f66685e16ced8ad5635b90078fdb650a5a3229f5da4a4c7785bb9d0b582f5216a4ffb3e8d5cda1873d03873ba90c69ffee30770b11c284f4fc81fade02736435', 'id': '8f3e3818-434c-4ee6-8608-d0ba1c3325eb', 'created_at': datetime.datetime(2026, 11, 1, 11, 40, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 40, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8f3e3818-434c-4ee6-8608-d0ba1c3325eb/file', 'properties': {}}, 'image_service': }' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406ddc09-5f6e-4671-85e2-6ede36949357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:45 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Volume volume-0284942c-daa8-4712-a4f1-e5ea2023a871 (0284942c-daa8-4712-a4f1-e5ea2023a871): created successfully Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406ddc09-5f6e-4671-85e2-6ede36949357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:45 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Flow 'volume_create_manager' (116fbe0b-97aa-4a6d-bc56-234aa6235b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b" returned: 0 in 0.525s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:45 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-038603ad-e3f3-43b6-a6b5-6db50d5c1f14 tempest-VolumeImageDependencyTests-1961363001 None] Created volume successfully. Nov 01 12:40:45 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b Nov 01 12:40:45 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:45 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Flow 'volume_create_manager' (447ff1e1-7dff-4249-82c8-f3d71fbd003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f3c57a-ad9d-4af2-8f50-56a97d60e7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-baff28d9-28da-4a2c-91f7-9af8bcd91228" returned: 0 in 0.397s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f3c57a-ad9d-4af2-8f50-56a97d60e7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1981353544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e48c9c8-713c-473f-a5d3-71a3dd69ac09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b99a567463438c8eedad338739d916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:46Z,use_quota=True,user_id='7403ecd6272e48ff8c261dbca3a0d7bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9e4398-6f15-454a-8573-802f2c862fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9e4398-6f15-454a-8573-802f2c862fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df681e5d-d09e-427a-ac38-2fecf1efb0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df681e5d-d09e-427a-ac38-2fecf1efb0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e48c9c8-713c-473f-a5d3-71a3dd69ac09', 'volume_name': 'volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1082bcf-a989-4514-bb21-bf38e4b8dd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1082bcf-a989-4514-bb21-bf38e4b8dd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944917c1-fd04-4725-9a25-4f906b2cae71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:45 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Volume 2e48c9c8-713c-473f-a5d3-71a3dd69ac09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09', 'volume_size': 1} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1981353544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e48c9c8-713c-473f-a5d3-71a3dd69ac09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b99a567463438c8eedad338739d916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:46Z,use_quota=True,user_id='7403ecd6272e48ff8c261dbca3a0d7bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Creating volume 2e48c9c8-713c-473f-a5d3-71a3dd69ac09 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:45 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-baff28d9-28da-4a2c-91f7-9af8bcd91228" released by "delete_volume" :: held 1.016s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:45 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 1073741824 Nov 01 12:40:45 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created reservations ['a3b55e7f-6be5-4f62-9ce7-63d644217bed', 'ff0f9066-bcd6-4274-a981-75351830a869', 'eed1a36b-321d-458a-b06a-3a6081dab1a0', '6e908823-e553-4e1c-8887-50814f595066'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:45 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-5f145d94-33a1-4f8e-8fa3-644746dd852b" returned: 0 in 0.283s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Lock "cinder-quobyte-5f145d94-33a1-4f8e-8fa3-644746dd852b" released by "delete_volume" :: held 0.857s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:45 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Created reservations ['819afbda-b000-4b6e-b62f-67660dad428d', 'bb7f4fa0-d432-48d6-85a0-09b624ccbebf', 'd80b2bb3-d183-4c8b-bd0f-7cba4212d31b', '658373b0-08f2-4e91-9224-7e9778b8592b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:45 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:45 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:46 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:46 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:46 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:46 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.311s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 1073741824" returned: 0 in 0.500s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Deleted volume successfully. Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9aed985e-cf03-44de-ad46-a5a248ad57af tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-baff28d9-28da-4a2c-91f7-9af8bcd91228-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:46 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 Nov 01 12:40:46 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:46 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.283s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Deleted volume successfully. Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-96bcfafd-0d8e-4a83-b98b-d52c4c1ee615 tempest-ProjectReaderTests-1711193897 None] Lock "cinder-5f145d94-33a1-4f8e-8fa3-644746dd852b-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:46 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944917c1-fd04-4725-9a25-4f906b2cae71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbeb157-74c4-472a-9adb-3f2e06e4fa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:46 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Volume volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 (2e48c9c8-713c-473f-a5d3-71a3dd69ac09): created successfully Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbeb157-74c4-472a-9adb-3f2e06e4fa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Flow 'volume_create_manager' (447ff1e1-7dff-4249-82c8-f3d71fbd003a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-807aa6ce-d214-4228-b1ba-2d577bb2e523 tempest-VolumeDependencyTests-1818815230 None] Created volume successfully. Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Acquiring lock "cinder-0284942c-daa8-4712-a4f1-e5ea2023a871-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Lock "cinder-0284942c-daa8-4712-a4f1-e5ea2023a871-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Acquiring lock "cinder-quobyte-0284942c-daa8-4712-a4f1-e5ea2023a871" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Lock "cinder-quobyte-0284942c-daa8-4712-a4f1-e5ea2023a871" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a37d959-15a3-45c4-93bd-c438d52594e2]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-0234c930-e4c7-4c1e-8caf-1841da116dcb-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-0234c930-e4c7-4c1e-8caf-1841da116dcb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-quobyte-0234c930-e4c7-4c1e-8caf-1841da116dcb" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:46 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 Nov 01 12:40:46 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-0234c930-e4c7-4c1e-8caf-1841da116dcb" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c33290-7c40-4bad-bb2d-24707af9f8ec]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:47 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb Nov 01 12:40:47 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:47 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871" returned: 0 in 0.432s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:47 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871 Nov 01 12:40:47 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:47 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb" returned: 0 in 0.432s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:47 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb Nov 01 12:40:47 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:47 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0284942c-daa8-4712-a4f1-e5ea2023a871" returned: 0 in 0.276s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Lock "cinder-quobyte-0284942c-daa8-4712-a4f1-e5ea2023a871" released by "delete_volume" :: held 0.754s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Flow 'volume_create_manager' (50a22129-a125-4b71-85f3-ebd7c5d99063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b32b25f-0efa-42e2-ae49-585480cb0901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Created reservations ['a5ad99c4-7291-4504-92a2-e41bc7d63d7f', '00ce23a4-18ea-40cf-b37c-f32e384d795c', '3d6ae6ba-6c41-419c-bf8c-c62f5c8bf3e6', '5d07673d-2501-4575-aa75-a765fb48effc'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b32b25f-0efa-42e2-ae49-585480cb0901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2016337144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db824634389d4664a71c293c4faaae39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:48Z,use_quota=True,user_id='ccd0a1efeadd450f93d49e66f7ce8980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0340d992-0e71-4171-855a-54f3629d404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0340d992-0e71-4171-855a-54f3629d404f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77324a99-d3bf-4145-9bd2-640391ec9994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77324a99-d3bf-4145-9bd2-640391ec9994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2', 'volume_name': 'volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5c670b-7e75-4739-9348-85f44420f725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e5c670b-7e75-4739-9348-85f44420f725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d95c50-f1ef-4d2f-b86a-a64b889e5bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:47 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Volume ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2', 'volume_size': 1} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2016337144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db824634389d4664a71c293c4faaae39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:48Z,use_quota=True,user_id='ccd0a1efeadd450f93d49e66f7ce8980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Creating volume ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:47 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:47 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0234c930-e4c7-4c1e-8caf-1841da116dcb" returned: 0 in 0.321s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:47 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 1073741824 Nov 01 12:40:47 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-0234c930-e4c7-4c1e-8caf-1841da116dcb" released by "delete_volume" :: held 0.809s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:47 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:47 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:47 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created reservations ['1ee1d874-9bc0-41e7-a85e-fc6acc144ae8', 'e2f9027b-aa85-4ee8-b5a1-c3523384d875', 'fa897453-7084-4f92-a5d3-67563cb75426', '2d2b0732-81da-4241-8255-a207168e6945'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:48 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:48 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:48 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.392s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Deleted volume successfully. Nov 01 12:40:48 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 1073741824" returned: 0 in 0.594s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6cca88f4-c976-4a4f-b6fa-8d5889cb0d78 tempest-VolumeImageDependencyTests-1961363001 None] Lock "cinder-0284942c-daa8-4712-a4f1-e5ea2023a871-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:48 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 Nov 01 12:40:48 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:48 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.326s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Deleted volume successfully. Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-5157fa5a-3fc2-41f0-bd77-f50d5954097f tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-0234c930-e4c7-4c1e-8caf-1841da116dcb-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:48 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2" returned: 0 in 0.282s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.628s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d95c50-f1ef-4d2f-b86a-a64b889e5bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e8f309-3e7e-4922-afd5-f690bbe883ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Creating offline snapshot 27477d3e-7d25-4b70-a64a-426951e30588 of volume 2e48c9c8-713c-473f-a5d3-71a3dd69ac09 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:40:48 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Volume volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 (ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2): created successfully Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e8f309-3e7e-4922-afd5-f690bbe883ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Flow 'volume_create_manager' (50a22129-a125-4b71-85f3-ebd7c5d99063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472c720-942e-40a3-af93-237911a17e7d]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-30a7e3b0-38ae-4e30-9d90-11e0cfed39f5 tempest-ProjectReaderTests-1711193897 None] Created volume successfully. Nov 01 12:40:48 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 Nov 01 12:40:48 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:49 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" returned: 0 in 0.402s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:49 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 1G Nov 01 12:40:49 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-7302f99f-f9c5-482d-9f0c-bc5d984965c9-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-7302f99f-f9c5-482d-9f0c-bc5d984965c9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-quobyte-7302f99f-f9c5-482d-9f0c-bc5d984965c9" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-7302f99f-f9c5-482d-9f0c-bc5d984965c9" acquired by "delete_volume" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ef8d6d-c63a-4d32-9c78-68f4b2a89f81]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:49 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9 Nov 01 12:40:49 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:49 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 1G" returned: 0 in 0.505s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:49 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 Nov 01 12:40:49 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Acquiring lock "cinder-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Lock "cinder-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Acquiring lock "cinder-quobyte-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:49 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9" returned: 0 in 0.513s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Lock "cinder-quobyte-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2" acquired by "delete_volume" :: waited 0.034s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:49 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9 Nov 01 12:40:49 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e5453f-fab2-4cac-9926-8b7e3a557804]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:50 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588" returned: 0 in 0.425s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:50 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 is being set with open permissions: ugo+rw Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:50 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 Nov 01 12:40:50 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:50 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 Nov 01 12:40:50 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:50 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7302f99f-f9c5-482d-9f0c-bc5d984965c9" returned: 0 in 0.360s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-7302f99f-f9c5-482d-9f0c-bc5d984965c9" released by "delete_volume" :: held 0.937s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created reservations ['9100bbca-8c90-4d47-b5b6-cf0e944fedec', '4657f89c-e0fa-4b30-8af7-0e0d148782cf', '9f2981ca-0a29-42bf-bc4c-648b34ba12db', '9830d741-c079-4b3d-98e8-c696263c5e8a'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:50 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588" returned: 0 in 0.379s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:50 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:50 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:50 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-7b9c673c-5e07-4736-905c-0b5c06b9e0b6-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2" returned: 0 in 0.591s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:50 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.info Nov 01 12:40:50 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-7b9c673c-5e07-4736-905c-0b5c06b9e0b6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:50 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2 Nov 01 12:40:50 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-quobyte-7b9c673c-5e07-4736-905c-0b5c06b9e0b6" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-7b9c673c-5e07-4736-905c-0b5c06b9e0b6" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60188c0-80ef-441f-ba72-fac532b8eb6f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:50 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.403s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:50 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.info" returned: 0 in 0.363s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:50 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.info is being set with open permissions: ugo+rw Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:50 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6 Nov 01 12:40:50 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Deleted volume successfully. Nov 01 12:40:50 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.info Nov 01 12:40:50 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4814e676-bbba-413d-84a9-f5f1942cd765 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-7302f99f-f9c5-482d-9f0c-bc5d984965c9-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:50 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2" returned: 0 in 0.453s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Lock "cinder-quobyte-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2" released by "delete_volume" :: held 1.115s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Created reservations ['eb28d417-1d8d-4d2d-a269-b7185cbbd820', 'b584e251-597e-4de4-b133-4e5c55ef6322', '8fe685b4-e300-4f10-b171-a99f1dd5648b', 'b0689eda-9bb6-4dfa-9959-a92ad790f049'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:51 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.info" returned: 0 in 0.335s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:51 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:51 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:51 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6" returned: 0 in 0.580s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:51 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d1d4d70b-5f2f-4c68-858d-cddb3b078a81 tempest-VolumeDependencyTests-1818815230 None] Create snapshot completed successfully Nov 01 12:40:51 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6 Nov 01 12:40:51 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:51 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.272s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:51 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Deleted volume successfully. Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-862ef55a-ece9-4909-9be0-7d905d3ed34e tempest-ProjectReaderTests-1711193897 None] Lock "cinder-ae105d9f-7d5c-4811-a8d5-58c42cf6bdc2-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:51 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-7b9c673c-5e07-4736-905c-0b5c06b9e0b6" returned: 0 in 0.273s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-7b9c673c-5e07-4736-905c-0b5c06b9e0b6" released by "delete_volume" :: held 0.914s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created reservations ['40682424-0b81-47db-8da0-e082c3660f79', '22eafd46-c642-44f7-80a6-e4dd34f06c98', '349d737a-464a-485f-a9fc-1cdf751c57e8', '5427aa35-a0e0-44a8-aec4-4aa078ed0740'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:51 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:51 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "cinder-quobyte-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82aaf26-479f-4d79-ac53-58e4627b685f]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:51 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e Nov 01 12:40:51 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:51 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.296s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:51 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Deleted volume successfully. Nov 01 12:40:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-85aa9087-95e8-4f68-bbee-9a63a4106357 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-7b9c673c-5e07-4736-905c-0b5c06b9e0b6-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d1355779-61a5-4b87-8381-53741aebe4ab tempest-ProjectAdminTests-758211981 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9067420959473, 'free_capacity_gb': 1773.9067420959473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86812) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 12:40:52 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e" returned: 0 in 0.485s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:52 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e Nov 01 12:40:52 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:52 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e" returned: 0 in 0.310s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-quobyte-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e" released by "delete_volume" :: held 0.858s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Created reservations ['f945ea7a-ee96-4c2a-89f0-92ccd3be9fe9', '87d43768-b970-40e8-a52e-3323ca227553', 'ac77f464-c782-435f-b5c2-4ee61f43a448', 'ddeb3739-8b91-431f-98de-14f61083c03c'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Flow 'volume_create_manager' (e5d41b1e-2a52-45b2-93f6-2f5e1114f371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5b2bc5-726f-47e4-bdb7-3b02b28daed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5b2bc5-726f-47e4-bdb7-3b02b28daed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-641518511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311a454c-9ce2-4f54-acec-d5300b33b621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6b99a567463438c8eedad338739d916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=27477d3e-7d25-4b70-a64a-426951e30588,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:53Z,use_quota=True,user_id='7403ecd6272e48ff8c261dbca3a0d7bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e01a55-1bb7-4efd-b93e-c08218317309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e01a55-1bb7-4efd-b93e-c08218317309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dae8f7f-fed6-4566-b06d-496e0245a978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dae8f7f-fed6-4566-b06d-496e0245a978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '311a454c-9ce2-4f54-acec-d5300b33b621', 'volume_name': 'volume-311a454c-9ce2-4f54-acec-d5300b33b621', 'volume_size': 1, 'snapshot_id': '27477d3e-7d25-4b70-a64a-426951e30588'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64352c5f-be73-45cb-9573-1f9a022fe425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64352c5f-be73-45cb-9573-1f9a022fe425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1c4424-f877-45f4-be7b-f9e9be62d56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:52 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Volume 311a454c-9ce2-4f54-acec-d5300b33b621: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-311a454c-9ce2-4f54-acec-d5300b33b621', 'volume_size': 1, 'snapshot_id': '27477d3e-7d25-4b70-a64a-426951e30588'} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "cinder-quobyte-27477d3e-7d25-4b70-a64a-426951e30588-311a454c-9ce2-4f54-acec-d5300b33b621" by "_create_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:52 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:40:52 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-27477d3e-7d25-4b70-a64a-426951e30588-311a454c-9ce2-4f54-acec-d5300b33b621" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Creating volume 311a454c-9ce2-4f54-acec-d5300b33b621 from snapshot 27477d3e-7d25-4b70-a64a-426951e30588 {{(pid=86812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "cinder-quobyte-311a454c-9ce2-4f54-acec-d5300b33b621" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-311a454c-9ce2-4f54-acec-d5300b33b621" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] snapshot: 27477d3e-7d25-4b70-a64a-426951e30588, volume: 311a454c-9ce2-4f54-acec-d5300b33b621, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d53673-a565-4c7c-85ea-a18c9f65c086]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:53 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 Nov 01 12:40:53 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:53 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.298s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:53 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Deleted volume successfully. Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-2bb28e80-1a27-48d3-ad65-7726c6d9acf6 tempest-CreateVolumesFromSourceVolumeTest-1998619726 None] Lock "cinder-ee5c8820-5bfb-42ab-b2bc-e8f752c9223e-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:53 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588" returned: 0 in 0.486s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7697a019-2f37-46c8-ba08-03b4475a4321]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:53 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 Nov 01 12:40:53 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:54 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" returned: 0 in 0.454s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:40:54 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:40:54 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:40:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:54 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 Nov 01 12:40:54 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Flow 'volume_create_manager' (54344401-fb3e-4795-b4d7-66e94c3334dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3586361-ad2b-4d81-8ea8-631961f8c6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3586361-ad2b-4d81-8ea8-631961f8c6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52726a7-54cf-4908-88f4-ca8c14774129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3393af229b4b2287f5d348d139731e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:00Z,use_quota=True,user_id='5249d392832749d1820ee8caf2c98382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa796c69-fced-47a7-aba9-7d5c2bdb8622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa796c69-fced-47a7-aba9-7d5c2bdb8622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4367e4-ac49-42dc-a4a1-522a4831773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4367e4-ac49-42dc-a4a1-522a4831773c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a52726a7-54cf-4908-88f4-ca8c14774129', 'volume_name': 'volume-a52726a7-54cf-4908-88f4-ca8c14774129', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04d11ab-1d65-4e38-b939-120fea1d9ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04d11ab-1d65-4e38-b939-120fea1d9ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4239b28-040e-44e4-a9ed-41213cd8cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:59 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Volume a52726a7-54cf-4908-88f4-ca8c14774129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a52726a7-54cf-4908-88f4-ca8c14774129', 'volume_size': 1} Nov 01 12:40:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:03 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621" returned: 0 in 9.339s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09, size 1024.00 MB, duration 9.34 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:41:03 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Converted 1024.00 MB image at 109.60 MB/s Nov 01 12:41:03 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 is being set with open permissions: ugo+rw Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:03 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 Nov 01 12:41:03 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:03 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621" returned: 0 in 0.286s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-311a454c-9ce2-4f54-acec-d5300b33b621" released by "_copy_volume_from_snapshot" :: held 10.685s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-27477d3e-7d25-4b70-a64a-426951e30588-311a454c-9ce2-4f54-acec-d5300b33b621" released by "_create_volume_from_snapshot" :: held 10.775s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.793s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.757s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52726a7-54cf-4908-88f4-ca8c14774129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3393af229b4b2287f5d348d139731e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:00Z,use_quota=True,user_id='5249d392832749d1820ee8caf2c98382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Creating volume a52726a7-54cf-4908-88f4-ca8c14774129 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:03 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:03 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129 1073741824 Nov 01 12:41:03 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa1c4424-f877-45f4-be7b-f9e9be62d56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311a454c-9ce2-4f54-acec-d5300b33b621', 'volume_size': 1, 'snapshot_id': '27477d3e-7d25-4b70-a64a-426951e30588'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b5162e-7516-4fa5-9004-27957bcb5560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:03 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Volume volume-311a454c-9ce2-4f54-acec-d5300b33b621 (311a454c-9ce2-4f54-acec-d5300b33b621): created successfully Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b5162e-7516-4fa5-9004-27957bcb5560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:03 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Flow 'volume_create_manager' (e5d41b1e-2a52-45b2-93f6-2f5e1114f371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:03 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9166da44-3eb1-4ec2-a2de-148ef7787f84 tempest-VolumeDependencyTests-1818815230 None] Created volume successfully. Nov 01 12:41:04 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129 1073741824" returned: 0 in 0.585s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:04 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129 Nov 01 12:41:04 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:04 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129" returned: 0 in 0.263s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4239b28-040e-44e4-a9ed-41213cd8cc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52726a7-54cf-4908-88f4-ca8c14774129', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85eb64d5-b7b5-4327-bb78-a7c849dedf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:04 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Volume volume-a52726a7-54cf-4908-88f4-ca8c14774129 (a52726a7-54cf-4908-88f4-ca8c14774129): created successfully Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85eb64d5-b7b5-4327-bb78-a7c849dedf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Flow 'volume_create_manager' (54344401-fb3e-4795-b4d7-66e94c3334dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:04 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6b2a4f4d-c696-4200-b0f4-4c979431a6ce tempest-CinderUnicodeTest-1654894764 None] Created volume successfully. Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "cinder-27477d3e-7d25-4b70-a64a-426951e30588-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-27477d3e-7d25-4b70-a64a-426951e30588-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "cinder-quobyte-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:04 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "cinder-quobyte-27477d3e-7d25-4b70-a64a-426951e30588" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-27477d3e-7d25-4b70-a64a-426951e30588" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Deleting offline snapshot 27477d3e-7d25-4b70-a64a-426951e30588 of volume 2e48c9c8-713c-473f-a5d3-71a3dd69ac09 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] snapshot_file for this snap is: volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:05 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[289a656f-dc0d-4f44-b57d-4dc6fbdadea2]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:05 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 Nov 01 12:41:05 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:05 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588" returned: 0 in 0.570s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:05 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2310fff6-80f4-40ba-af03-406b51903ff8]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:05 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 Nov 01 12:41:05 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=267,cinder:SELECT=177,cinder:INSERT=69,cinder:DELETE=24 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Flow 'volume_create_manager' (2b0c1ec6-bcd0-434e-a6e2-502a25a22142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d156851f-f97e-4a36-b011-4dd3a0122698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d156851f-f97e-4a36-b011-4dd3a0122698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2101891167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=021e1e9b-9c48-462d-8f7f-ad023cb4fad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3393af229b4b2287f5d348d139731e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:06Z,use_quota=True,user_id='5249d392832749d1820ee8caf2c98382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40180443-4a22-4070-ac44-ec2d19227397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40180443-4a22-4070-ac44-ec2d19227397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b07ea06-1047-4782-ae64-1091613c24f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b07ea06-1047-4782-ae64-1091613c24f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '021e1e9b-9c48-462d-8f7f-ad023cb4fad5', 'volume_name': 'volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892da7ac-0f96-4a06-818f-3c5176c7dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892da7ac-0f96-4a06-818f-3c5176c7dd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43281b6-52e8-45f6-a539-31b1e977b297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:06 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Volume 021e1e9b-9c48-462d-8f7f-ad023cb4fad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5', 'volume_size': 1} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2101891167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=021e1e9b-9c48-462d-8f7f-ad023cb4fad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3393af229b4b2287f5d348d139731e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:06Z,use_quota=True,user_id='5249d392832749d1820ee8caf2c98382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Creating volume 021e1e9b-9c48-462d-8f7f-ad023cb4fad5 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:06 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:06 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:06 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 1073741824 Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" returned: 0 in 0.666s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:06 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:06 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 Nov 01 12:41:06 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:06 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588" returned: 0 in 0.386s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:06 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588 Nov 01 12:41:06 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:06 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 1073741824" returned: 0 in 0.553s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=184,cinder:UPDATE=238,cinder:DELETE=23,cinder:INSERT=64 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:41:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:07 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 Nov 01 12:41:07 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:07 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09.27477d3e-7d25-4b70-a64a-426951e30588" returned: 0 in 0.409s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-27477d3e-7d25-4b70-a64a-426951e30588" released by "_delete_snapshot" :: held 2.191s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" released by "delete_snapshot" :: held 2.222s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Created reservations ['87811b96-0ea7-463d-a420-e9f2a4031513', '007bcc9f-9ba4-471c-b877-28778feb52c0', '6cd34135-6964-4380-b439-25317d799882', 'f834f633-1867-47b0-aa9e-5963a40b0685'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:07 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" returned: 0 in 0.441s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:07 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Delete snapshot completed successfully. Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43281b6-52e8-45f6-a539-31b1e977b297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58c22c6-b098-43d8-ac29-06a2bc0b329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4631215d-611b-49f8-b47f-c16f50717b3f tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-27477d3e-7d25-4b70-a64a-426951e30588-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:07 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Volume volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 (021e1e9b-9c48-462d-8f7f-ad023cb4fad5): created successfully Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58c22c6-b098-43d8-ac29-06a2bc0b329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Flow 'volume_create_manager' (2b0c1ec6-bcd0-434e-a6e2-502a25a22142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:07 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ac8b7b63-1a07-4f17-aa84-880d92197826 tempest-CinderUnicodeTest-1654894764 None] Created volume successfully. Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Flow 'volume_create_manager' (6bb2e946-2d46-4588-8cc1-7a49a74a6674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2082d3-2ae0-43b0-addd-2ebd0cea9054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2082d3-2ae0-43b0-addd-2ebd0cea9054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1185478237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ddafbb-c9e8-43f1-85cc-b8a512e82343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097b077fc5c4a47b61c68515f121f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:07Z,use_quota=True,user_id='7816ae9f8f284abc870cc1129439c1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ddca58-8cca-4df9-8041-fedf95a4be08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ddca58-8cca-4df9-8041-fedf95a4be08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acb6934-3b1e-4d68-98cb-5e3988db6684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2acb6934-3b1e-4d68-98cb-5e3988db6684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ddafbb-c9e8-43f1-85cc-b8a512e82343', 'volume_name': 'volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164d1187-4f83-41ac-9097-6c900d2cddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164d1187-4f83-41ac-9097-6c900d2cddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a46d4b7-aa37-47a8-838c-9c535a0cc19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:07 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Volume d7ddafbb-c9e8-43f1-85cc-b8a512e82343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343', 'volume_size': 1} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1185478237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ddafbb-c9e8-43f1-85cc-b8a512e82343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097b077fc5c4a47b61c68515f121f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:07Z,use_quota=True,user_id='7816ae9f8f284abc870cc1129439c1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Creating volume d7ddafbb-c9e8-43f1-85cc-b8a512e82343 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:07 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:07 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 1073741824 Nov 01 12:41:07 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:08 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 1073741824" returned: 0 in 0.456s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:08 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 Nov 01 12:41:08 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "cinder-2e48c9c8-713c-473f-a5d3-71a3dd69ac09-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-2e48c9c8-713c-473f-a5d3-71a3dd69ac09-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "cinder-quobyte-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" acquired by "delete_volume" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:08 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" returned: 0 in 0.395s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a494655-ba90-4d6e-8c46-731a7001425a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a46d4b7-aa37-47a8-838c-9c535a0cc19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a807a28-9f80-4319-893b-84004c3a562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:08 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Volume volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 (d7ddafbb-c9e8-43f1-85cc-b8a512e82343): created successfully Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a807a28-9f80-4319-893b-84004c3a562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Flow 'volume_create_manager' (6bb2e946-2d46-4588-8cc1-7a49a74a6674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:08 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a518e921-14af-42ff-a597-e17e257e71d1 tempest-ProjectReaderTests-1851713611 None] Created volume successfully. Nov 01 12:41:08 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:08 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Creating offline snapshot dffbda98-0f00-4b1e-b46a-6cfeea03af96 of volume 021e1e9b-9c48-462d-8f7f-ad023cb4fad5 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4340219d-85b4-4178-8cad-84444de8f968]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:08 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 Nov 01 12:41:08 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:08 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" returned: 0 in 0.476s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:08 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09 Nov 01 12:41:08 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:09 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" returned: 0 in 0.429s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:09 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 1G Nov 01 12:41:09 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:09 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" returned: 0 in 0.269s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-2e48c9c8-713c-473f-a5d3-71a3dd69ac09" released by "delete_volume" :: held 0.848s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Created reservations ['6dd152e7-ada3-4f24-bd28-4bf8b601da65', '255f00b8-ee77-400e-a651-caae82fb454f', '552cf2b3-8a76-47b9-b507-f496185327af', '24a36e93-439f-40df-9c6e-5858e9b82e1c'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:09 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:09 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "cinder-311a454c-9ce2-4f54-acec-d5300b33b621-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-311a454c-9ce2-4f54-acec-d5300b33b621-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "cinder-quobyte-311a454c-9ce2-4f54-acec-d5300b33b621" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:09 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:09 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.379s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 1G" returned: 0 in 0.636s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Deleted volume successfully. Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-311a454c-9ce2-4f54-acec-d5300b33b621" acquired by "delete_volume" :: waited 0.057s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:09 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 Nov 01 12:41:09 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8515d36e-57aa-40f2-a33b-6693cb75ad8d]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ccfbaaa3-6ab1-426c-9611-6c25bd001b04 tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-2e48c9c8-713c-473f-a5d3-71a3dd69ac09-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:10 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 Nov 01 12:41:10 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:10 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96" returned: 0 in 0.393s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:10 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 is being set with open permissions: ugo+rw Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:10 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 Nov 01 12:41:10 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:10 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621" returned: 0 in 0.516s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:10 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621 Nov 01 12:41:10 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:10 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96" returned: 0 in 0.274s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:10 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.info Nov 01 12:41:10 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:10 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-311a454c-9ce2-4f54-acec-d5300b33b621" returned: 0 in 0.268s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-quobyte-311a454c-9ce2-4f54-acec-d5300b33b621" released by "delete_volume" :: held 0.851s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Created reservations ['878d2b26-248a-4226-b608-da767227b70f', 'a3e27d19-0e34-4232-ba90-13abfb8fb0c9', '5e0ddf1e-61de-4a99-b457-3a8a6b642c0e', 'a62c1543-0f4a-4b70-ae76-c81cf56e6bd0'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:10 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.info" returned: 0 in 0.336s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:10 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.info is being set with open permissions: ugo+rw Nov 01 12:41:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:10 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:10 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:10 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.info Nov 01 12:41:10 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:11 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.info" returned: 0 in 0.274s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:11 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.181s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.323s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Deleted volume successfully. Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Creating offline snapshot 725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 of volume d7ddafbb-c9e8-43f1-85cc-b8a512e82343 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:11 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5a3ff073-7b2e-411d-86c5-a8f57c0726f9 tempest-CinderUnicodeTest-1654894764 None] Create snapshot completed successfully Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-395d8875-da85-4adb-8d99-4e50006ffc6f tempest-VolumeDependencyTests-1818815230 None] Lock "cinder-311a454c-9ce2-4f54-acec-d5300b33b621-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ba199-7da2-47cb-a9a0-9ea05dfc4cc1]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:11 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 Nov 01 12:41:11 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:11 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" returned: 0 in 0.389s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:11 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 1G Nov 01 12:41:11 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:11 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "cinder-dffbda98-0f00-4b1e-b46a-6cfeea03af96-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-dffbda98-0f00-4b1e-b46a-6cfeea03af96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "cinder-quobyte-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-quobyte-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "cinder-quobyte-dffbda98-0f00-4b1e-b46a-6cfeea03af96" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-quobyte-dffbda98-0f00-4b1e-b46a-6cfeea03af96" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Deleting offline snapshot dffbda98-0f00-4b1e-b46a-6cfeea03af96 of volume 021e1e9b-9c48-462d-8f7f-ad023cb4fad5 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] snapshot_file for this snap is: volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c280c3-1737-4a6d-9633-ec78770c9596]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:12 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 1G" returned: 0 in 0.614s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:12 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 Nov 01 12:41:12 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:12 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 Nov 01 12:41:12 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:12 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96" returned: 0 in 0.563s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:12 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9" returned: 0 in 0.473s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:12 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 is being set with open permissions: ugo+rw Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6704a8-95f5-4b01-8d27-396f9c6401a8]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:12 devstack sudo[107951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 Nov 01 12:41:12 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:12 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 Nov 01 12:41:12 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:13 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9" returned: 0 in 0.426s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:13 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.info Nov 01 12:41:13 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:13 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" returned: 0 in 0.525s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:13 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 Nov 01 12:41:13 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:13 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.info" returned: 0 in 0.284s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:13 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.info is being set with open permissions: ugo+rw Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:13 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.info Nov 01 12:41:13 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:13 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96" returned: 0 in 0.388s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:13 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96 Nov 01 12:41:13 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:13 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.info" returned: 0 in 0.301s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:13 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-41730b96-545d-4453-836f-99b94f93a3d1 tempest-ProjectReaderTests-1851713611 None] Create snapshot completed successfully Nov 01 12:41:13 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5.dffbda98-0f00-4b1e-b46a-6cfeea03af96" returned: 0 in 0.269s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-quobyte-dffbda98-0f00-4b1e-b46a-6cfeea03af96" released by "_delete_snapshot" :: held 1.923s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-quobyte-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" released by "delete_snapshot" :: held 1.961s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Created reservations ['fc25fb6e-1b06-4ec0-b7ba-659e7c334ae3', 'd87fe4fe-74dd-4865-9b97-557a2447a004', '6008704d-cb2a-48fb-9934-3e086a4b059d', 'b557dfbe-6ee8-4650-82f1-b2ee4680314d'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:14 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Delete snapshot completed successfully. Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-08e87e9a-5d14-40a3-9ffc-de05aea8b3b7 tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-dffbda98-0f00-4b1e-b46a-6cfeea03af96-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "cinder-021e1e9b-9c48-462d-8f7f-ad023cb4fad5-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-021e1e9b-9c48-462d-8f7f-ad023cb4fad5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "cinder-quobyte-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-quobyte-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac746030-085b-4a89-94f7-dc66bb72f200]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:14 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 Nov 01 12:41:14 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-725d2ba0-35f7-4b5b-8f4b-24f20789c6a9-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-725d2ba0-35f7-4b5b-8f4b-24f20789c6a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-725d2ba0-35f7-4b5b-8f4b-24f20789c6a9" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-725d2ba0-35f7-4b5b-8f4b-24f20789c6a9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Deleting offline snapshot 725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 of volume d7ddafbb-c9e8-43f1-85cc-b8a512e82343 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] snapshot_file for this snap is: volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1268518f-803e-4f47-aaf3-5b1d8de86403]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:14 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:14 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" returned: 0 in 0.469s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:14 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:14 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5 Nov 01 12:41:14 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:15 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" returned: 0 in 0.400s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:15 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9" returned: 0 in 0.556s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-quobyte-021e1e9b-9c48-462d-8f7f-ad023cb4fad5" released by "delete_volume" :: held 0.996s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccb78bb-2725-4299-9e8f-cdcf37044aa3]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Created reservations ['3f607d8d-2ed6-482d-850e-840a42f01413', '2dc9c1b0-8ebd-4cac-82fa-de406322db11', '69cf4a3c-7161-4cf5-9b2c-4b092ed1fd56', 'bb6ccc09-7246-45f9-895c-4ee7b5f74b1b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:15 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 Nov 01 12:41:15 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:15 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:15 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:15 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" returned: 0 in 0.502s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:15 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 Nov 01 12:41:15 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:15 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (a1f56c0c-fa65-467c-aa68-bd7f1a0489eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80da960-4dd6-4a38-b519-76b21df632e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:16 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.416s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80da960-4dd6-4a38-b519-76b21df632e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-759339420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a25bbc5-0bce-4e85-a469-b20119fb5996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:16Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e795210a-681d-4a9f-9fb2-35d31aae211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e795210a-681d-4a9f-9fb2-35d31aae211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c7a1f6-9dd1-4990-bad2-5f1ee74f13d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c7a1f6-9dd1-4990-bad2-5f1ee74f13d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a25bbc5-0bce-4e85-a469-b20119fb5996', 'volume_name': 'volume-3a25bbc5-0bce-4e85-a469-b20119fb5996', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2164f68-688f-4be3-b274-4344276428f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2164f68-688f-4be3-b274-4344276428f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d772912-2170-4c4b-98c9-022c15c512ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:16 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Volume 3a25bbc5-0bce-4e85-a469-b20119fb5996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a25bbc5-0bce-4e85-a469-b20119fb5996', 'volume_size': 1} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-759339420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a25bbc5-0bce-4e85-a469-b20119fb5996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:16Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Creating volume 3a25bbc5-0bce-4e85-a469-b20119fb5996 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:16 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Deleted volume successfully. Nov 01 12:41:16 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 1073741824 Nov 01 12:41:16 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b337a5af-bd3e-4ed2-ab1f-9b276da4c2a5 tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-021e1e9b-9c48-462d-8f7f-ad023cb4fad5-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:16 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9" returned: 0 in 0.410s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:16 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9 Nov 01 12:41:16 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "cinder-a52726a7-54cf-4908-88f4-ca8c14774129-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-a52726a7-54cf-4908-88f4-ca8c14774129-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "cinder-quobyte-a52726a7-54cf-4908-88f4-ca8c14774129" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-quobyte-a52726a7-54cf-4908-88f4-ca8c14774129" acquired by "delete_volume" :: waited 0.024s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:16 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:16 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343.725d2ba0-35f7-4b5b-8f4b-24f20789c6a9" returned: 0 in 0.360s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 1073741824" returned: 0 in 0.594s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff046e52-959d-4759-af5f-c1477ab9c85e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-725d2ba0-35f7-4b5b-8f4b-24f20789c6a9" released by "_delete_snapshot" :: held 1.987s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" released by "delete_snapshot" :: held 2.019s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:16 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 Nov 01 12:41:16 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:16 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129 Nov 01 12:41:16 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Created reservations ['5c8d124a-6bc2-4f01-bc3f-9e3fdc8af14e', '94eaca42-7ed3-49e7-aabc-e56fde3e29a4', 'd709c587-43f9-4cf1-b9c7-523df6d8a215', '4d1cbd66-3bb8-4a11-8e8d-a2afb5cd37eb'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Delete snapshot completed successfully. Nov 01 12:41:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-451d9cbd-2046-40c0-8e57-0e843b924066 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-725d2ba0-35f7-4b5b-8f4b-24f20789c6a9-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:17 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996" returned: 0 in 0.336s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d772912-2170-4c4b-98c9-022c15c512ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a25bbc5-0bce-4e85-a469-b20119fb5996', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b03ae96-9697-49fb-a248-b0ba07100c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:17 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129" returned: 0 in 0.440s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:17 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Volume volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 (3a25bbc5-0bce-4e85-a469-b20119fb5996): created successfully Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b03ae96-9697-49fb-a248-b0ba07100c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (a1f56c0c-fa65-467c-aa68-bd7f1a0489eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:17 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129 Nov 01 12:41:17 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:17 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d379d1c1-f1ac-4b38-bca3-663939881323 tempest-ProjectMemberTests-1337080014 None] Created volume successfully. Nov 01 12:41:17 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a52726a7-54cf-4908-88f4-ca8c14774129" returned: 0 in 0.269s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-quobyte-a52726a7-54cf-4908-88f4-ca8c14774129" released by "delete_volume" :: held 0.786s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Created reservations ['e709cd5b-6d68-49b4-9db6-aee6b0a440cd', 'abc6f4de-b140-45ec-80a1-00f1f9b1ac9b', 'f3cba950-322d-4e51-85ee-fb524337c0dc', '60bcb989-86f7-4e5b-b370-55c922e107e3'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:17 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:17 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:17 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.281s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:17 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Deleted volume successfully. Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b90c88f7-547d-451c-9065-fc8fac864b5c tempest-CinderUnicodeTest-1654894764 None] Lock "cinder-a52726a7-54cf-4908-88f4-ca8c14774129-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:17 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-d7ddafbb-c9e8-43f1-85cc-b8a512e82343-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-d7ddafbb-c9e8-43f1-85cc-b8a512e82343-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e265319-9238-4fca-b305-67111416b6d1]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:18 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 Nov 01 12:41:18 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:18 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" returned: 0 in 0.449s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:18 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343 Nov 01 12:41:18 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Creating offline snapshot 2c0b2315-5ca6-43de-9823-6ca973650945 of volume 3a25bbc5-0bce-4e85-a469-b20119fb5996 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a289c6c-eb47-4ba6-97e0-0c73c78b1e50]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:18 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 Nov 01 12:41:18 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:18 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" returned: 0 in 0.329s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-d7ddafbb-c9e8-43f1-85cc-b8a512e82343" released by "delete_volume" :: held 0.869s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Created reservations ['880bd134-221a-4241-859a-4dca6459c26c', 'e9eed1cd-48eb-42ac-bfde-0d6f215a4a56', 'd3a62a00-b6d4-494d-a623-926c377eafe6', '32d04944-925f-4fb8-825a-4274e2b3fe64'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:19 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:19 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:19 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996" returned: 0 in 0.576s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:19 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 1G Nov 01 12:41:19 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:19 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.535s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:19 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Deleted volume successfully. Nov 01 12:41:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-9910dfc9-f7a7-4e69-899c-01ad82577104 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-d7ddafbb-c9e8-43f1-85cc-b8a512e82343-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:20 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 1G" returned: 0 in 0.650s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:20 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Flow 'volume_create_manager' (b8cd4cd0-9a0b-4dad-b8b2-00ea41b101ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:20 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6083a016-fbe5-4113-ad7d-01204b7c309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6083a016-fbe5-4113-ad7d-01204b7c309c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-995016085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ad0415-8864-456a-a8b5-a127941e17ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097b077fc5c4a47b61c68515f121f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:20Z,use_quota=True,user_id='7816ae9f8f284abc870cc1129439c1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267ed537-80ab-42fb-89cb-55ec3df526dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267ed537-80ab-42fb-89cb-55ec3df526dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e41bc5-866a-4a6b-a479-cebe694cc4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e41bc5-866a-4a6b-a479-cebe694cc4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ad0415-8864-456a-a8b5-a127941e17ee', 'volume_name': 'volume-20ad0415-8864-456a-a8b5-a127941e17ee', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af20821a-c4d3-46be-93f3-208070b1d953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af20821a-c4d3-46be-93f3-208070b1d953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f342c7a-a51b-450c-9c0c-8079a91b5199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:20 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Volume 20ad0415-8864-456a-a8b5-a127941e17ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ad0415-8864-456a-a8b5-a127941e17ee', 'volume_size': 1} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:20 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945" returned: 0 in 0.399s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:20 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 is being set with open permissions: ugo+rw Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:20 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 Nov 01 12:41:20 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:20 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945" returned: 0 in 0.290s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:20 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.info Nov 01 12:41:20 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:21 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.info" returned: 0 in 0.364s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:21 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.info is being set with open permissions: ugo+rw Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:21 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.info Nov 01 12:41:21 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:21 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.info" returned: 0 in 0.270s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.275s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-995016085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ad0415-8864-456a-a8b5-a127941e17ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097b077fc5c4a47b61c68515f121f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:20Z,use_quota=True,user_id='7816ae9f8f284abc870cc1129439c1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Creating volume 20ad0415-8864-456a-a8b5-a127941e17ee {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:21 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:21 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee 1073741824 Nov 01 12:41:21 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:21 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a375402e-9e62-4b5e-8021-17160c4b8018 tempest-ProjectMemberTests-1337080014 None] Create snapshot completed successfully Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-2c0b2315-5ca6-43de-9823-6ca973650945-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:21 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee 1073741824" returned: 0 in 0.553s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-2c0b2315-5ca6-43de-9823-6ca973650945-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-3a25bbc5-0bce-4e85-a469-b20119fb5996" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-3a25bbc5-0bce-4e85-a469-b20119fb5996" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-2c0b2315-5ca6-43de-9823-6ca973650945" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-2c0b2315-5ca6-43de-9823-6ca973650945" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Deleting offline snapshot 2c0b2315-5ca6-43de-9823-6ca973650945 of volume 3a25bbc5-0bce-4e85-a469-b20119fb5996 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] snapshot_file for this snap is: volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fa32b6-2cd9-4588-a111-2dcb6160c902]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:22 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee Nov 01 12:41:22 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:22 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 Nov 01 12:41:22 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:22 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee" returned: 0 in 0.458s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f342c7a-a51b-450c-9c0c-8079a91b5199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ad0415-8864-456a-a8b5-a127941e17ee', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd603c4-6cae-4ce3-93a9-6af46d36eba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:22 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Volume volume-20ad0415-8864-456a-a8b5-a127941e17ee (20ad0415-8864-456a-a8b5-a127941e17ee): created successfully Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd603c4-6cae-4ce3-93a9-6af46d36eba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Flow 'volume_create_manager' (b8cd4cd0-9a0b-4dad-b8b2-00ea41b101ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:22 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e221dd22-b8c9-42e3-9159-88c7aa7c765a tempest-ProjectReaderTests-1851713611 None] Created volume successfully. Nov 01 12:41:22 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945" returned: 0 in 0.517s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a25bbc5-0bce-4e85-a469-b20119fb5996(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[23390dbb-8f74-47ec-84a1-75597d4e7489]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:22 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 Nov 01 12:41:22 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:23 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996" returned: 0 in 0.414s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:23 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 Nov 01 12:41:23 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:23 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945" returned: 0 in 0.398s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:23 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945 Nov 01 12:41:23 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Creating offline snapshot fa3d4014-233f-4f2d-8acf-5bab389e8fb2 of volume 20ad0415-8864-456a-a8b5-a127941e17ee {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b41ab36-c3d6-4b1b-b53c-f5892715d343]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:23 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996.2c0b2315-5ca6-43de-9823-6ca973650945" returned: 0 in 0.400s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:23 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee Nov 01 12:41:23 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-2c0b2315-5ca6-43de-9823-6ca973650945" released by "_delete_snapshot" :: held 1.925s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-3a25bbc5-0bce-4e85-a469-b20119fb5996" released by "delete_snapshot" :: held 1.965s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:24 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Created reservations ['973c4360-53fa-4025-a3fc-e729c9d48d98', 'cfea3edc-67d0-420a-8717-5d5059e10a79', '3a0d0c34-687b-40c2-96e7-78130b1ecc55', '32a6fc8f-947b-470d-a54f-bdcf480dbfc3'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:24 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Delete snapshot completed successfully. Nov 01 12:41:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6a6631f2-ea7d-499c-9e36-9e5bef92daf4 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-2c0b2315-5ca6-43de-9823-6ca973650945-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:24 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee" returned: 0 in 0.488s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:24 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 1G Nov 01 12:41:24 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:24 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 1G" returned: 0 in 0.400s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ad0415-8864-456a-a8b5-a127941e17ee -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:24 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ad0415-8864-456a-a8b5-a127941e17ee -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 Nov 01 12:41:24 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:25 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ad0415-8864-456a-a8b5-a127941e17ee -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2" returned: 0 in 0.319s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:25 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 is being set with open permissions: ugo+rw Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:25 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 Nov 01 12:41:25 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Flow 'volume_create_manager' (1d439adf-f47e-4994-9a44-4b003a4b885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88884bd-a078-4625-bb2a-7d9153fc35de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b88884bd-a078-4625-bb2a-7d9153fc35de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-622612189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec653ba-bb88-4e6e-a007-8b050cc6d9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b88c3c55b34cb188e4349e1e94acb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:25Z,use_quota=True,user_id='eaa2ead8e41b46f4a91c5d14b73017a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fd678b-238a-49dc-a298-3d1b87603948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9fd678b-238a-49dc-a298-3d1b87603948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057c8610-3f06-47f6-885c-8aca5ea56789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057c8610-3f06-47f6-885c-8aca5ea56789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec653ba-bb88-4e6e-a007-8b050cc6d9c6', 'volume_name': 'volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1365e3d1-6e25-4906-a238-5ba2399b6f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1365e3d1-6e25-4906-a238-5ba2399b6f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd331f11-35f1-423f-8fdd-8604129ccd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Volume 0ec653ba-bb88-4e6e-a007-8b050cc6d9c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6', 'volume_size': 1} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-3a25bbc5-0bce-4e85-a469-b20119fb5996-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Lock "cinder-3a25bbc5-0bce-4e85-a469-b20119fb5996-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-3a25bbc5-0bce-4e85-a469-b20119fb5996" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-3a25bbc5-0bce-4e85-a469-b20119fb5996" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:25 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2" returned: 0 in 0.267s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f678c26d-7b99-476b-8005-71a2bb406949]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:25 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.info Nov 01 12:41:25 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:25 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 Nov 01 12:41:25 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:25 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.info" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:25 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.info is being set with open permissions: ugo+rw Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:25 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.info Nov 01 12:41:25 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:25 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996" returned: 0 in 0.370s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:25 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996 Nov 01 12:41:25 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:25 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.info" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-622612189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec653ba-bb88-4e6e-a007-8b050cc6d9c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b88c3c55b34cb188e4349e1e94acb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:25Z,use_quota=True,user_id='eaa2ead8e41b46f4a91c5d14b73017a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Creating volume 0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:25 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:25 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 1073741824 Nov 01 12:41:25 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ba379d08-dbbf-4a4c-a9ff-07b09fa32ccf tempest-ProjectReaderTests-1851713611 None] Create snapshot completed successfully Nov 01 12:41:25 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3a25bbc5-0bce-4e85-a469-b20119fb5996" returned: 0 in 0.263s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:25 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-3a25bbc5-0bce-4e85-a469-b20119fb5996" released by "delete_volume" :: held 0.706s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Created reservations ['a03d53bf-70c6-4d5d-8129-66f72be8291f', '316fea28-cdd1-4bf8-842e-0ceec9ea328a', '58741534-c17d-4ee8-ab77-233c7feeafc6', 'd43590b7-0534-46e5-b4d7-d661374ee169'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:26 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:26 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:26 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 1073741824" returned: 0 in 0.436s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:26 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.269s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:26 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Deleted volume successfully. Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f09e6406-b47e-429c-8ff4-8debbe5eb5cd tempest-ProjectMemberTests-1337080014 None] Lock "cinder-3a25bbc5-0bce-4e85-a469-b20119fb5996-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:26 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 Nov 01 12:41:26 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:26 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" returned: 0 in 0.248s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd331f11-35f1-423f-8fdd-8604129ccd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c685005-84d1-41cb-9d6b-aa4e641d6026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:26 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Volume volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 (0ec653ba-bb88-4e6e-a007-8b050cc6d9c6): created successfully Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c685005-84d1-41cb-9d6b-aa4e641d6026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Flow 'volume_create_manager' (1d439adf-f47e-4994-9a44-4b003a4b885f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:26 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d9c4f6ae-57d5-413c-8091-fcf7ebbcc117 tempest-SnapshotDependencyTests-318256564 None] Created volume successfully. Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (b29c2a09-a2a2-43b3-ac85-5c025df2ad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211f346c-23c8-4b76-93c8-0bad1d8945aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211f346c-23c8-4b76-93c8-0bad1d8945aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800964540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caabf68c-8456-4acf-90ec-5f42ba035fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:27Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7009d470-d458-4ac5-9c56-6dc472d7c699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7009d470-d458-4ac5-9c56-6dc472d7c699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8dedb89-01c9-42cf-b7fc-f547cb742e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8dedb89-01c9-42cf-b7fc-f547cb742e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caabf68c-8456-4acf-90ec-5f42ba035fe7', 'volume_name': 'volume-caabf68c-8456-4acf-90ec-5f42ba035fe7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7970f76a-b9c6-4f56-8f46-842bceb6b3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7970f76a-b9c6-4f56-8f46-842bceb6b3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b87e93-4eac-46f7-b6d1-12565c519029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:26 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Volume caabf68c-8456-4acf-90ec-5f42ba035fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caabf68c-8456-4acf-90ec-5f42ba035fe7', 'volume_size': 1} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-800964540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caabf68c-8456-4acf-90ec-5f42ba035fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:27Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Creating volume caabf68c-8456-4acf-90ec-5f42ba035fe7 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:26 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-fa3d4014-233f-4f2d-8acf-5bab389e8fb2-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:26 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 1073741824 Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-fa3d4014-233f-4f2d-8acf-5bab389e8fb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-20ad0415-8864-456a-a8b5-a127941e17ee" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:26 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-20ad0415-8864-456a-a8b5-a127941e17ee" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-fa3d4014-233f-4f2d-8acf-5bab389e8fb2" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-fa3d4014-233f-4f2d-8acf-5bab389e8fb2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Deleting offline snapshot fa3d4014-233f-4f2d-8acf-5bab389e8fb2 of volume 20ad0415-8864-456a-a8b5-a127941e17ee {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] snapshot_file for this snap is: volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2ba294-2c58-41c4-bb52-18ac596c2964]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:27 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 Nov 01 12:41:27 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:27 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 1073741824" returned: 0 in 0.520s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:27 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2" returned: 0 in 0.445s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20ad0415-8864-456a-a8b5-a127941e17ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b7b504-061f-49d8-a367-f94b146bba11]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:27 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 Nov 01 12:41:27 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:27 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee Nov 01 12:41:27 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:27 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7" returned: 0 in 0.258s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.276s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b87e93-4eac-46f7-b6d1-12565c519029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caabf68c-8456-4acf-90ec-5f42ba035fe7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5da77db-2f8f-4cbb-94b8-79d2c38d4905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Creating offline snapshot ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 of volume 0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:27 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Volume volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 (caabf68c-8456-4acf-90ec-5f42ba035fe7): created successfully Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5da77db-2f8f-4cbb-94b8-79d2c38d4905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (b29c2a09-a2a2-43b3-ac85-5c025df2ad67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5bf1c4-2616-481d-be18-ddfcc3f1c803]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9c07ad6a-c756-48da-beae-2d4ae991acb5 tempest-ProjectMemberTests-1337080014 None] Created volume successfully. Nov 01 12:41:27 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee" returned: 0 in 0.398s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:27 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 Nov 01 12:41:27 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:27 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 Nov 01 12:41:27 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:28 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" returned: 0 in 0.380s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:28 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2" returned: 0 in 0.339s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:28 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 1G Nov 01 12:41:28 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:28 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2 Nov 01 12:41:28 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:28 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee.fa3d4014-233f-4f2d-8acf-5bab389e8fb2" returned: 0 in 0.240s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-fa3d4014-233f-4f2d-8acf-5bab389e8fb2" released by "_delete_snapshot" :: held 1.536s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-20ad0415-8864-456a-a8b5-a127941e17ee" released by "delete_snapshot" :: held 1.560s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Created reservations ['b8a56137-8e39-4892-8f2f-5ae157b9b534', '246f7405-83ed-487d-9675-f9e0622ba01a', 'f50a864a-9c80-4901-a629-10dbfb7ba5cc', '388f698b-6b55-40de-8025-67bde71d94cf'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Delete snapshot completed successfully. Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d7d26874-dd46-41d9-a18f-805643d032b9 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-fa3d4014-233f-4f2d-8acf-5bab389e8fb2-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:28 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 1G" returned: 0 in 0.430s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:28 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 Nov 01 12:41:28 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:28 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9" returned: 0 in 0.289s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:28 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 is being set with open permissions: ugo+rw Nov 01 12:41:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:28 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 Nov 01 12:41:28 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-20ad0415-8864-456a-a8b5-a127941e17ee-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-20ad0415-8864-456a-a8b5-a127941e17ee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-20ad0415-8864-456a-a8b5-a127941e17ee" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-20ad0415-8864-456a-a8b5-a127941e17ee" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:29 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaffde4-ab20-4656-83e8-1b4c779d1f19]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9" returned: 0 in 0.307s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:29 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.info Nov 01 12:41:29 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:29 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee Nov 01 12:41:29 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:29 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.info" returned: 0 in 0.262s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:29 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.info is being set with open permissions: ugo+rw Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:29 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.info Nov 01 12:41:29 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:29 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee" returned: 0 in 0.366s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:29 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee Nov 01 12:41:29 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:29 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.info" returned: 0 in 0.240s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.666s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Creating offline snapshot de429d3a-7b4c-46f3-80a2-67449a3b1124 of volume caabf68c-8456-4acf-90ec-5f42ba035fe7 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:29 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-5d781b71-6063-4f3e-9d28-4f729eb9a08a tempest-SnapshotDependencyTests-318256564 None] Create snapshot completed successfully Nov 01 12:41:29 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-20ad0415-8864-456a-a8b5-a127941e17ee" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9110973-4e55-4746-bb09-8fa417277823]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-20ad0415-8864-456a-a8b5-a127941e17ee" released by "delete_volume" :: held 0.692s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Created reservations ['e2105eda-74c8-4840-a078-cbf14423e595', 'd3656184-d804-4e05-a779-2b1d83752aad', '57a44f90-d0dc-474f-a4f6-2b75fe84a073', '41c90828-dad2-4e0e-ab98-c72a8c091b79'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:29 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 Nov 01 12:41:29 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:30 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:30 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:30 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7" returned: 0 in 0.389s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:30 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.266s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:30 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Deleted volume successfully. Nov 01 12:41:30 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 1G Nov 01 12:41:30 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-622ba25d-579f-43a9-9c72-badd8de56002 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-20ad0415-8864-456a-a8b5-a127941e17ee-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Flow 'volume_create_manager' (d51bf503-853a-4574-a7d2-b80e7f6df0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:30 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565102c8-235c-432d-bcea-6e606da77f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 1G" returned: 0 in 0.507s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565102c8-235c-432d-bcea-6e606da77f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877315860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca496ae-e81e-4eff-b521-35daef3b0cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097b077fc5c4a47b61c68515f121f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:31Z,use_quota=True,user_id='7816ae9f8f284abc870cc1129439c1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:30 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 Nov 01 12:41:30 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb5512f-cf1c-4fa6-9853-0d0420b49b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fb5512f-cf1c-4fa6-9853-0d0420b49b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f4ca63-a190-4179-9473-aa4bd8389fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f4ca63-a190-4179-9473-aa4bd8389fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca496ae-e81e-4eff-b521-35daef3b0cf0', 'volume_name': 'volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f8ef72-c7dc-4a71-a47f-567196ee7a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f8ef72-c7dc-4a71-a47f-567196ee7a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc4c7b8-75ad-40dd-b27c-37c8fdc86fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:30 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Volume 3ca496ae-e81e-4eff-b521-35daef3b0cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0', 'volume_size': 1} Nov 01 12:41:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:31 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124" returned: 0 in 0.323s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:31 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 is being set with open permissions: ugo+rw Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:31 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 Nov 01 12:41:31 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Flow 'volume_create_manager' (35ba2d5e-7e54-4648-952b-c26542d876e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ae2098-f2ba-414c-bb4c-40e152ee6b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ae2098-f2ba-414c-bb4c-40e152ee6b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=869d8acb-5819-44e5-8d4b-2e3e43458718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b88c3c55b34cb188e4349e1e94acb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:31Z,use_quota=True,user_id='eaa2ead8e41b46f4a91c5d14b73017a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072bb157-b83f-4473-a50a-54acfa9ae464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072bb157-b83f-4473-a50a-54acfa9ae464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9160fdff-3ae5-4022-85ca-981721fe7df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9160fdff-3ae5-4022-85ca-981721fe7df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '869d8acb-5819-44e5-8d4b-2e3e43458718', 'volume_name': 'volume-869d8acb-5819-44e5-8d4b-2e3e43458718', 'volume_size': 1, 'snapshot_id': 'ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d618602-78bf-49a4-84e3-1928750a103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d618602-78bf-49a4-84e3-1928750a103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bda24f-e3e8-4ee6-941b-5ea8be465c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:31 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Volume 869d8acb-5819-44e5-8d4b-2e3e43458718: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-869d8acb-5819-44e5-8d4b-2e3e43458718', 'volume_size': 1, 'snapshot_id': 'ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9'} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:31 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124" returned: 0 in 0.266s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:31 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.info Nov 01 12:41:31 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:31 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.info" returned: 0 in 0.246s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:31 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.info is being set with open permissions: ugo+rw Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:31 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.info Nov 01 12:41:31 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:31 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.info" returned: 0 in 0.240s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.068s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877315860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca496ae-e81e-4eff-b521-35daef3b0cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097b077fc5c4a47b61c68515f121f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:31Z,use_quota=True,user_id='7816ae9f8f284abc870cc1129439c1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Creating volume 3ca496ae-e81e-4eff-b521-35daef3b0cf0 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:31 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:31 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 1073741824 Nov 01 12:41:31 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:31 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-0eb64d7f-39c7-444a-9ded-1ebb37d7c3af tempest-ProjectMemberTests-1337080014 None] Create snapshot completed successfully Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-de429d3a-7b4c-46f3-80a2-67449a3b1124-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Lock "cinder-de429d3a-7b4c-46f3-80a2-67449a3b1124-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-caabf68c-8456-4acf-90ec-5f42ba035fe7" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-caabf68c-8456-4acf-90ec-5f42ba035fe7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-de429d3a-7b4c-46f3-80a2-67449a3b1124" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-de429d3a-7b4c-46f3-80a2-67449a3b1124" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Deleting offline snapshot de429d3a-7b4c-46f3-80a2-67449a3b1124 of volume caabf68c-8456-4acf-90ec-5f42ba035fe7 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:32 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] snapshot_file for this snap is: volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 1073741824" returned: 0 in 0.469s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4b748b-20f4-4689-a2f9-f9982e146051]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:32 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 Nov 01 12:41:32 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:32 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 Nov 01 12:41:32 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:32 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0" returned: 0 in 0.239s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.306s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "cinder-quobyte-ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9-869d8acb-5819-44e5-8d4b-2e3e43458718" by "_create_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc4c7b8-75ad-40dd-b27c-37c8fdc86fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47ba11c-3c29-4f47-b80d-d03950baa12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9-869d8acb-5819-44e5-8d4b-2e3e43458718" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Creating volume 869d8acb-5819-44e5-8d4b-2e3e43458718 from snapshot ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 {{(pid=86812) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "cinder-quobyte-869d8acb-5819-44e5-8d4b-2e3e43458718" by "_copy_volume_from_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:32 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Volume volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 (3ca496ae-e81e-4eff-b521-35daef3b0cf0): created successfully Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47ba11c-3c29-4f47-b80d-d03950baa12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Flow 'volume_create_manager' (d51bf503-853a-4574-a7d2-b80e7f6df0b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-869d8acb-5819-44e5-8d4b-2e3e43458718" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] snapshot: ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9, volume: 869d8acb-5819-44e5-8d4b-2e3e43458718, {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:41:32 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ce037124-4b35-4031-b607-eaca48a12838 tempest-ProjectReaderTests-1851713611 None] Created volume successfully. Nov 01 12:41:32 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124" returned: 0 in 0.387s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caabf68c-8456-4acf-90ec-5f42ba035fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[135f7150-37a9-4a03-922f-fe6664cb68d2]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd87b15-00d2-4317-af09-22b777e6d201]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:32 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 Nov 01 12:41:32 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:32 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 Nov 01 12:41:32 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:33 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7" returned: 0 in 0.397s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:33 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9" returned: 0 in 0.394s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:33 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 Nov 01 12:41:33 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fc2667-a575-4abc-9da1-e53c6db4c95a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:33 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 Nov 01 12:41:33 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:33 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124" returned: 0 in 0.336s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:33 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124 Nov 01 12:41:33 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:33 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" returned: 0 in 0.380s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Creating direct copy from snapshot {{(pid=86812) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG cinder.utils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Path /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 not found in is_blk_device check {{(pid=86812) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:33 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 Nov 01 12:41:33 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:33 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7.de429d3a-7b4c-46f3-80a2-67449a3b1124" returned: 0 in 0.246s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-de429d3a-7b4c-46f3-80a2-67449a3b1124" released by "_delete_snapshot" :: held 1.518s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-caabf68c-8456-4acf-90ec-5f42ba035fe7" released by "delete_snapshot" :: held 1.540s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Created reservations ['199d79f5-f99d-4b6e-8f37-beb3b2cc8406', '48dbe995-856c-4206-bb9d-604fb113fb65', 'a857b49f-5aaf-491e-807c-1d2c9eb0cd86', '574e7796-3dc2-4cb8-8bea-b6a4800bb9f5'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:33 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Delete snapshot completed successfully. Nov 01 12:41:33 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-3ee9cb61-43e1-4dbf-a347-487c6ce8f48d tempest-ProjectMemberTests-1337080014 None] Lock "cinder-de429d3a-7b4c-46f3-80a2-67449a3b1124-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-caabf68c-8456-4acf-90ec-5f42ba035fe7-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-caabf68c-8456-4acf-90ec-5f42ba035fe7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-caabf68c-8456-4acf-90ec-5f42ba035fe7" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:34 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-caabf68c-8456-4acf-90ec-5f42ba035fe7" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:34 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe8d053-446b-4e20-a859-6f8733716a40]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:35 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 Nov 01 12:41:35 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:35 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7" returned: 0 in 0.579s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:35 devstack sudo[108287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7 Nov 01 12:41:35 devstack sudo[108287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:35 devstack sudo[108287]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-caabf68c-8456-4acf-90ec-5f42ba035fe7" returned: 0 in 0.384s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-caabf68c-8456-4acf-90ec-5f42ba035fe7" released by "delete_volume" :: held 1.105s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:35 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Created reservations ['be684c58-3cad-47ec-bcdc-96ad8c1a260b', 'becd62fb-afd6-4eab-8cc5-4a139cdd365f', '1c801200-5feb-4388-84f4-4603f6bcdc7c', '269a2aae-1c0c-4cd1-be1d-10714e9a3cb7'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:36 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:36 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:36 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.316s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:36 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Deleted volume successfully. Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-df0ace02-da0c-447f-846f-503b95fc7fe9 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-caabf68c-8456-4acf-90ec-5f42ba035fe7-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:37 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:37 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:37 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.483s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 29 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (6e6c26f0-15b5-4c3c-a4c7-1dcdc9d3b028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21510088-0299-4474-8259-621201add63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21510088-0299-4474-8259-621201add63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998052216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff07fd1-a80c-4bd5-9208-992b72dcdc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:38Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedfa2ae-0c05-4b46-afc3-cc4044f1aa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dedfa2ae-0c05-4b46-afc3-cc4044f1aa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5f8f42-a9c4-44dd-a174-05db52cecdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e5f8f42-a9c4-44dd-a174-05db52cecdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff07fd1-a80c-4bd5-9208-992b72dcdc08', 'volume_name': 'volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fe8746-cf6e-4c0b-9bda-68a3df278b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fe8746-cf6e-4c0b-9bda-68a3df278b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04446b96-e89c-4ab4-b458-09cee987a749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:37 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Volume cff07fd1-a80c-4bd5-9208-992b72dcdc08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08', 'volume_size': 1} Nov 01 12:41:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:40 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718" returned: 0 in 6.665s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.image.image_utils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Image conversion details: src /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 {{(pid=86812) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:41:40 devstack cinder-volume[86812]: INFO cinder.image.image_utils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Converted 1024.00 MB image at 153.63 MB/s Nov 01 12:41:40 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 is being set with open permissions: ugo+rw Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:40 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 Nov 01 12:41:40 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:40 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718" returned: 0 in 0.232s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-869d8acb-5819-44e5-8d4b-2e3e43458718" released by "_copy_volume_from_snapshot" :: held 7.807s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9-869d8acb-5819-44e5-8d4b-2e3e43458718" released by "_create_volume_from_snapshot" :: held 7.889s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.936s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.592s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Creating offline snapshot d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 of volume 3ca496ae-e81e-4eff-b521-35daef3b0cf0 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bda24f-e3e8-4ee6-941b-5ea8be465c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-869d8acb-5819-44e5-8d4b-2e3e43458718', 'volume_size': 1, 'snapshot_id': 'ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9'}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2e5a60-6a7c-40cc-96b7-07048e9c2d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65d395a-3016-49d1-bb87-68e7f93dd08c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:40 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Volume volume-869d8acb-5819-44e5-8d4b-2e3e43458718 (869d8acb-5819-44e5-8d4b-2e3e43458718): created successfully Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2e5a60-6a7c-40cc-96b7-07048e9c2d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Flow 'volume_create_manager' (35ba2d5e-7e54-4648-952b-c26542d876e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:40 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-18ba9f5b-8805-4863-ad33-ccc449aeebaf tempest-SnapshotDependencyTests-318256564 None] Created volume successfully. Nov 01 12:41:40 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 Nov 01 12:41:40 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "cinder-ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "cinder-quobyte-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "cinder-quobyte-ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Deleting offline snapshot ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 of volume 0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:40 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] snapshot_file for this snap is: volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de8d7ae-2eac-4b71-af42-d1a6183fdb91]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:41 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0" returned: 0 in 0.387s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:41 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 1G Nov 01 12:41:41 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:41 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 Nov 01 12:41:41 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:41 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9" returned: 0 in 0.360s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[60205474-c70b-414e-a90e-80569863664c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:41 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 1G" returned: 0 in 0.403s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:41 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 Nov 01 12:41:41 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:41 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 Nov 01 12:41:41 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:41 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12" returned: 0 in 0.302s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:41 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 is being set with open permissions: ugo+rw Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:41 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 Nov 01 12:41:41 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:41 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" returned: 0 in 0.532s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:41 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 Nov 01 12:41:41 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:41 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12" returned: 0 in 0.241s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:41 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:42 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.info Nov 01 12:41:42 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:42 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.info" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:42 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.info is being set with open permissions: ugo+rw Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:42 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9" returned: 0 in 0.332s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:42 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.info Nov 01 12:41:42 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:42 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9 Nov 01 12:41:42 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:42 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.info" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:42 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.687s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1998052216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff07fd1-a80c-4bd5-9208-992b72dcdc08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:38Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Creating volume cff07fd1-a80c-4bd5-9208-992b72dcdc08 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:42 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6.ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9" returned: 0 in 0.287s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:42 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 1073741824 Nov 01 12:41:42 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-90c0b9ca-e042-4650-a24b-bc1f410c3c3f tempest-ProjectReaderTests-1851713611 None] Create snapshot completed successfully Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9" released by "_delete_snapshot" :: held 1.630s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" released by "delete_snapshot" :: held 1.657s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Created reservations ['ce875a22-8523-4fad-bd4e-8c80106313c6', 'ba6b01cf-984f-4f92-bc84-29e83d58001b', '0e3e3326-2e99-4737-bbaf-4f2873433c6e', '8966a5d0-c381-4c9c-87e0-be25e3f6b370'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:42 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Delete snapshot completed successfully. Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-98645e14-0d9c-4715-a5d8-80043df68bd8 tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-ca6881ab-a28e-4bf1-b3f4-acf04a11a6a9-delete_snapshot" released by "delete_snapshot" :: held 1.787s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:42 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 1073741824" returned: 0 in 0.409s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:42 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:42 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 Nov 01 12:41:42 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "cinder-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "cinder-quobyte-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" acquired by "delete_volume" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b23e9b-ac61-40ac-8416-8950420e4c4d]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:43 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04446b96-e89c-4ab4-b458-09cee987a749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c51b01a-a65a-449e-b134-dc0f793d02a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:43 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Volume volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 (cff07fd1-a80c-4bd5-9208-992b72dcdc08): created successfully Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c51b01a-a65a-449e-b134-dc0f793d02a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (6e6c26f0-15b5-4c3c-a4c7-1dcdc9d3b028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:43 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a5bed9c4-62d1-4441-bedd-2a7b42b73dfd tempest-ProjectMemberTests-1337080014 None] Created volume successfully. Nov 01 12:41:43 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 Nov 01 12:41:43 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-3ca496ae-e81e-4eff-b521-35daef3b0cf0" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-3ca496ae-e81e-4eff-b521-35daef3b0cf0" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Deleting offline snapshot d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 of volume 3ca496ae-e81e-4eff-b521-35daef3b0cf0 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:43 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] snapshot_file for this snap is: volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" returned: 0 in 0.387s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf38607-f1ad-4740-a45e-7e7909f77987]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:43 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6 Nov 01 12:41:43 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:43 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 Nov 01 12:41:43 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:43 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" returned: 0 in 0.245s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6" released by "delete_volume" :: held 0.736s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Created reservations ['a51a0656-6fa8-477b-98f0-4de87affca05', 'b38b340c-9bc2-4940-a3ca-1e395d240597', 'a3009e91-953c-4b99-a8e9-b8dfd29cbbaa', '1f09df37-fabc-47a0-9690-a953a2b20866'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:43 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12" returned: 0 in 0.358s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:43 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[22334ee0-e15c-45dc-a121-991728f28ae8]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:44 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:44 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:44 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 Nov 01 12:41:44 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Creating offline snapshot 54051fd5-542b-41c7-8daa-ee8232874e4e of volume cff07fd1-a80c-4bd5-9208-992b72dcdc08 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6094dcc0-8020-445c-9e21-2c2d7560756c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "cinder-869d8acb-5819-44e5-8d4b-2e3e43458718-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-869d8acb-5819-44e5-8d4b-2e3e43458718-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:44 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 Nov 01 12:41:44 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "cinder-quobyte-869d8acb-5819-44e5-8d4b-2e3e43458718" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-869d8acb-5819-44e5-8d4b-2e3e43458718" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:44 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:44 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.398s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0" returned: 0 in 0.437s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:44 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Deleted volume successfully. Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa43c251-4ace-4bd1-8cbb-d059d2bbd77c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:44 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 Nov 01 12:41:44 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-20e7e5c7-bf58-42c0-8407-f345e741eeb2 tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-0ec653ba-bb88-4e6e-a007-8b050cc6d9c6-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:44 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 Nov 01 12:41:44 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:44 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08" returned: 0 in 0.464s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:44 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e 1G Nov 01 12:41:44 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:44 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12" returned: 0 in 0.394s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:44 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12 Nov 01 12:41:44 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:44 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718" returned: 0 in 0.412s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:44 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:44 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718 Nov 01 12:41:44 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:45 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e 1G" returned: 0 in 0.437s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:45 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e Nov 01 12:41:45 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:45 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0.d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12" returned: 0 in 0.289s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12" released by "_delete_snapshot" :: held 1.614s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:45 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-869d8acb-5819-44e5-8d4b-2e3e43458718" returned: 0 in 0.286s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-3ca496ae-e81e-4eff-b521-35daef3b0cf0" released by "delete_snapshot" :: held 1.644s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-quobyte-869d8acb-5819-44e5-8d4b-2e3e43458718" released by "delete_volume" :: held 0.799s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Created reservations ['7be55a05-4a24-438f-be44-df62dae851ef', '56a8d2c9-2df3-44d2-8810-a8bf5abfa8ee', '0eea40da-6101-4311-8f7d-4def755f2416', 'c3591c30-d1b7-486b-9ab5-2603de97e5ad'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Created reservations ['023ab087-0ef3-40bb-979e-e409df32d457', '425130d2-f55b-402f-8f4a-ae363bc279a2', '99974b60-3bf6-4af3-99dc-4e73c14a351f', 'c374cfd5-4422-45c1-9d40-c282cce61aa9'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:45 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Delete snapshot completed successfully. Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6bacc6d2-2f91-4512-8249-34163bdf1aa4 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-d9a0e3cf-61e0-4877-9c7f-6c0af4d92d12-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:45 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:45 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:45 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e" returned: 0 in 0.345s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:45 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e is being set with open permissions: ugo+rw Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:45 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e Nov 01 12:41:45 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:45 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.306s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-3ca496ae-e81e-4eff-b521-35daef3b0cf0-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:45 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Deleted volume successfully. Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Lock "cinder-3ca496ae-e81e-4eff-b521-35daef3b0cf0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:45 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-244ffe22-ef98-4a97-b68f-e6ae42fb45cc tempest-SnapshotDependencyTests-318256564 None] Lock "cinder-869d8acb-5819-44e5-8d4b-2e3e43458718-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e" returned: 0 in 0.299s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-3ca496ae-e81e-4eff-b521-35daef3b0cf0" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:45 devstack sudo[108417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.info Nov 01 12:41:45 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-3ca496ae-e81e-4eff-b521-35daef3b0cf0" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae5896-c7d8-4597-8d10-7d07ee859575]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:45 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:45 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 Nov 01 12:41:45 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:46 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.info" returned: 0 in 0.273s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:46 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.info is being set with open permissions: ugo+rw Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:46 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.info Nov 01 12:41:46 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:46 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0" returned: 0 in 0.407s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:46 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0 Nov 01 12:41:46 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:46 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.info" returned: 0 in 0.298s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8cfd3870-748f-4668-b02d-9b3652cdb73c tempest-ProjectMemberTests-1337080014 None] Create snapshot completed successfully Nov 01 12:41:46 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-3ca496ae-e81e-4eff-b521-35daef3b0cf0" returned: 0 in 0.299s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-3ca496ae-e81e-4eff-b521-35daef3b0cf0" released by "delete_volume" :: held 0.790s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Created reservations ['4173acd6-04f7-45bf-ad3f-9162b8d9236f', 'bbd98f20-3170-4fcc-8286-27928038fbfd', '941aa2e7-4ebf-4d6e-9555-2387afc5402e', '4e52d386-ec02-4cd4-b2a4-be40af22d5dc'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:46 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:46 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:46 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:46 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Deleted volume successfully. Nov 01 12:41:46 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-8586111b-e090-45b1-a62e-db05381de4fc tempest-ProjectReaderTests-1851713611 None] Lock "cinder-3ca496ae-e81e-4eff-b521-35daef3b0cf0-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-54051fd5-542b-41c7-8daa-ee8232874e4e-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Lock "cinder-54051fd5-542b-41c7-8daa-ee8232874e4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-cff07fd1-a80c-4bd5-9208-992b72dcdc08" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Flow 'volume_create_manager' (85bd73b5-3e59-4f92-bc8c-439f35e39b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ee119a-61b6-4ae3-a5ef-f112c882fdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19ee119a-61b6-4ae3-a5ef-f112c882fdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059899687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17770973-85a3-4476-a9aa-115526129d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097b077fc5c4a47b61c68515f121f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:47Z,use_quota=True,user_id='7816ae9f8f284abc870cc1129439c1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565357ba-2168-4216-bd65-c0520a4fd808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565357ba-2168-4216-bd65-c0520a4fd808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b64ebb7-cb67-420a-ab02-8924fdac5337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b64ebb7-cb67-420a-ab02-8924fdac5337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17770973-85a3-4476-a9aa-115526129d29', 'volume_name': 'volume-17770973-85a3-4476-a9aa-115526129d29', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006f963b-ea83-472f-919d-2f48629fd8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006f963b-ea83-472f-919d-2f48629fd8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac88c41-b23d-4aa4-98f5-eb7e5e0ab597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:47 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Volume 17770973-85a3-4476-a9aa-115526129d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17770973-85a3-4476-a9aa-115526129d29', 'volume_size': 1} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1059899687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17770973-85a3-4476-a9aa-115526129d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097b077fc5c4a47b61c68515f121f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:47Z,use_quota=True,user_id='7816ae9f8f284abc870cc1129439c1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Creating volume 17770973-85a3-4476-a9aa-115526129d29 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:47 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-cff07fd1-a80c-4bd5-9208-992b72dcdc08" acquired by "delete_snapshot" :: waited 0.118s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-54051fd5-542b-41c7-8daa-ee8232874e4e" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-54051fd5-542b-41c7-8daa-ee8232874e4e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:47 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 1073741824 Nov 01 12:41:47 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Deleting offline snapshot 54051fd5-542b-41c7-8daa-ee8232874e4e of volume cff07fd1-a80c-4bd5-9208-992b72dcdc08 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] snapshot_file for this snap is: volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ae849-7f8e-4d80-8edc-0c100deef23a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:47 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e Nov 01 12:41:47 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:47 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 1073741824" returned: 0 in 0.470s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:47 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e" returned: 0 in 0.410s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:47 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba62120-3c68-4b10-a690-7597b41d67a0]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:48 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 Nov 01 12:41:48 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:48 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 Nov 01 12:41:48 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:48 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29" returned: 0 in 0.278s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac88c41-b23d-4aa4-98f5-eb7e5e0ab597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17770973-85a3-4476-a9aa-115526129d29', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e3da4c-d837-42e7-8e7b-019c08770a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:48 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Volume volume-17770973-85a3-4476-a9aa-115526129d29 (17770973-85a3-4476-a9aa-115526129d29): created successfully Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e3da4c-d837-42e7-8e7b-019c08770a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Flow 'volume_create_manager' (85bd73b5-3e59-4f92-bc8c-439f35e39b50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:48 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b73cc53a-95cd-4996-b00f-a368c3bb3a59 tempest-ProjectReaderTests-1851713611 None] Created volume successfully. Nov 01 12:41:48 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08" returned: 0 in 0.392s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:48 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e Nov 01 12:41:48 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:48 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e" returned: 0 in 0.321s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:48 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e Nov 01 12:41:48 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:48 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:48 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08.54051fd5-542b-41c7-8daa-ee8232874e4e" returned: 0 in 0.246s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-54051fd5-542b-41c7-8daa-ee8232874e4e" released by "_delete_snapshot" :: held 1.497s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-cff07fd1-a80c-4bd5-9208-992b72dcdc08" released by "delete_snapshot" :: held 1.526s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Created reservations ['0ed427db-d389-4d8a-b560-db2bbe7f3b19', '27f8883b-8a9c-44e1-bd3c-c8cf5ab9fb7e', 'ea121622-c55f-4da0-98bd-7ce4783b6661', '2e1d9cd1-d33d-486d-a24e-110c0a6d7125'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:49 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Delete snapshot completed successfully. Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-44a9f907-286c-4647-9651-ea694fad0a6a tempest-ProjectMemberTests-1337080014 None] Lock "cinder-54051fd5-542b-41c7-8daa-ee8232874e4e-delete_snapshot" released by "delete_snapshot" :: held 1.831s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-cff07fd1-a80c-4bd5-9208-992b72dcdc08-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-cff07fd1-a80c-4bd5-9208-992b72dcdc08-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-cff07fd1-a80c-4bd5-9208-992b72dcdc08" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-cff07fd1-a80c-4bd5-9208-992b72dcdc08" acquired by "delete_volume" :: waited 0.020s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5f438c-21c4-4c71-87d9-17643bc8c95c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Creating offline snapshot a16e3063-4b72-4456-92d1-8223fece0f63 of volume 17770973-85a3-4476-a9aa-115526129d29 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f97b68-dc43-458d-8a2d-68c1d272e946]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:49 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:49 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 Nov 01 12:41:49 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:49 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 Nov 01 12:41:49 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:50 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08" returned: 0 in 0.451s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:50 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29" returned: 0 in 0.408s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:50 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08 Nov 01 12:41:50 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:50 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 1G Nov 01 12:41:50 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:50 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-cff07fd1-a80c-4bd5-9208-992b72dcdc08" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-cff07fd1-a80c-4bd5-9208-992b72dcdc08" released by "delete_volume" :: held 0.801s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Created reservations ['3f050da0-290f-4f24-9ea3-e0355b1953c5', '2d494fb7-62b3-4351-82f4-6117e373f0e9', 'afc42a10-d8e6-431c-8027-0b5beb9fc963', '429a9f65-2e56-49d0-a536-4429046e54ac'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:50 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:50 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:50 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 1G" returned: 0 in 0.506s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17770973-85a3-4476-a9aa-115526129d29 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:50 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17770973-85a3-4476-a9aa-115526129d29 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 Nov 01 12:41:50 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:50 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.336s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:50 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:50 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Deleted volume successfully. Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-b1ae655b-a0ec-4abd-8a82-397994a088b1 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-cff07fd1-a80c-4bd5-9208-992b72dcdc08-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:51 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17770973-85a3-4476-a9aa-115526129d29 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63" returned: 0 in 0.365s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:51 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 is being set with open permissions: ugo+rw Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:51 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 Nov 01 12:41:51 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (1dae2544-1a99-47f0-a757-cb538b3295a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8cc1a5-f255-4fc2-a150-edd04575d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd8cc1a5-f255-4fc2-a150-edd04575d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784111979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c9a463-6d92-481b-bcaa-5f2d3e254cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:51Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3be2b5e-497c-422a-8105-2b535cbd6a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3be2b5e-497c-422a-8105-2b535cbd6a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a07fa6-eba5-4209-9095-6f30ab963a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a07fa6-eba5-4209-9095-6f30ab963a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6c9a463-6d92-481b-bcaa-5f2d3e254cf7', 'volume_name': 'volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305e3cd6-1f98-4c48-bec6-de46b558221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:51 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305e3cd6-1f98-4c48-bec6-de46b558221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b295e4d4-4273-4e77-8da4-19b0fe9b3b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:51 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Volume e6c9a463-6d92-481b-bcaa-5f2d3e254cf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7', 'volume_size': 1} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63" returned: 0 in 0.305s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:51 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.info Nov 01 12:41:51 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:51 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.info" returned: 0 in 0.274s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:51 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.info is being set with open permissions: ugo+rw Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:51 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.info Nov 01 12:41:51 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:51 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.info" returned: 0 in 0.242s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.187s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.563s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-784111979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6c9a463-6d92-481b-bcaa-5f2d3e254cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:51Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Creating volume e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:51 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:51 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:51 devstack sudo[108501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 1073741824 Nov 01 12:41:51 devstack sudo[108501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:51 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8d3fc40a-4a77-41d9-a910-f8cf1c910e7d tempest-ProjectReaderTests-1851713611 None] Create snapshot completed successfully Nov 01 12:41:52 devstack sudo[108501]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 1073741824" returned: 0 in 0.446s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:52 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 Nov 01 12:41:52 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:52 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b295e4d4-4273-4e77-8da4-19b0fe9b3b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5700fd0-276a-4308-b748-eaf9d5c1b0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:52 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Volume volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 (e6c9a463-6d92-481b-bcaa-5f2d3e254cf7): created successfully Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5700fd0-276a-4308-b748-eaf9d5c1b0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (1dae2544-1a99-47f0-a757-cb538b3295a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:52 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-da926978-7fa2-45f2-9110-cb7c0d2e02f3 tempest-ProjectMemberTests-1337080014 None] Created volume successfully. Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-a16e3063-4b72-4456-92d1-8223fece0f63-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-a16e3063-4b72-4456-92d1-8223fece0f63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-17770973-85a3-4476-a9aa-115526129d29" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-17770973-85a3-4476-a9aa-115526129d29" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-a16e3063-4b72-4456-92d1-8223fece0f63" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-a16e3063-4b72-4456-92d1-8223fece0f63" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Deleting offline snapshot a16e3063-4b72-4456-92d1-8223fece0f63 of volume 17770973-85a3-4476-a9aa-115526129d29 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] snapshot_file for this snap is: volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f6ce53-b3e7-4ec3-bc5f-daa70c34347a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:52 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:53 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 Nov 01 12:41:53 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:53 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63" returned: 0 in 0.388s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17770973-85a3-4476-a9aa-115526129d29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6fa16e-8cbd-4c55-ba01-5dd48ea26120]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:53 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 Nov 01 12:41:53 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Creating offline snapshot b007dce3-88c5-4dfe-a4cd-055b7cff108f of volume e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f03aa14-7569-43ff-8a0e-726609e5f4a3]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:53 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 Nov 01 12:41:53 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:53 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29" returned: 0 in 0.469s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:53 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:53 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 Nov 01 12:41:53 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:54 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" returned: 0 in 0.402s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:54 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f 1G Nov 01 12:41:54 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:54 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63" returned: 0 in 0.411s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:54 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63 Nov 01 12:41:54 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:54 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29.a16e3063-4b72-4456-92d1-8223fece0f63" returned: 0 in 0.319s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:54 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f 1G" returned: 0 in 0.511s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-a16e3063-4b72-4456-92d1-8223fece0f63" released by "_delete_snapshot" :: held 1.714s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-17770973-85a3-4476-a9aa-115526129d29" released by "delete_snapshot" :: held 1.740s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:54 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f Nov 01 12:41:54 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Created reservations ['8eb6e1bf-87f7-4e00-a16e-e59921678f44', '4879274a-e062-42fb-bfd2-040884a0abd3', 'a41af478-622f-4124-aedd-8ca3070593c5', '53b6c050-9307-49ff-b56a-bc481785794e'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:54 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Delete snapshot completed successfully. Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-952c3c8f-13a2-497a-8478-aa4118d6fc78 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-a16e3063-4b72-4456-92d1-8223fece0f63-delete_snapshot" released by "delete_snapshot" :: held 1.919s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:54 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f" returned: 0 in 0.320s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:54 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f is being set with open permissions: ugo+rw Nov 01 12:41:54 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:54 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f Nov 01 12:41:54 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-17770973-85a3-4476-a9aa-115526129d29-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-17770973-85a3-4476-a9aa-115526129d29-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-17770973-85a3-4476-a9aa-115526129d29" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-17770973-85a3-4476-a9aa-115526129d29" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f2387-932d-4f0f-bb3e-8ddaa5e658ea]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:55 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f" returned: 0 in 0.299s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:55 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 Nov 01 12:41:55 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:55 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.info Nov 01 12:41:55 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:55 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.info" returned: 0 in 0.297s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:55 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.info is being set with open permissions: ugo+rw Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:55 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29" returned: 0 in 0.453s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:55 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.info Nov 01 12:41:55 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:55 devstack sudo[108559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29 Nov 01 12:41:55 devstack sudo[108559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:55 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.info" returned: 0 in 0.257s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:55 devstack sudo[108559]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-17770973-85a3-4476-a9aa-115526129d29" returned: 0 in 0.270s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-17770973-85a3-4476-a9aa-115526129d29" released by "delete_volume" :: held 0.801s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:55 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e00e9fb0-7dba-4507-a1ed-0fc63f181898 tempest-ProjectMemberTests-1337080014 None] Create snapshot completed successfully Nov 01 12:41:55 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Created reservations ['5439219b-b511-44ee-88ab-b41fe9f04334', '81105d0c-6c6c-4801-93f9-2563451f88c8', '715c1d2b-710d-457e-85e4-134d067f89fd', 'ca2be8e0-1d9a-477d-a595-8814bbf7b366'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:56 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:41:56 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:56 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.265s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:41:56 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Deleted volume successfully. Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-d642c9da-3862-4d44-a037-f0e93d69a0b7 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-17770973-85a3-4476-a9aa-115526129d29-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Flow 'volume_create_manager' (3d738180-57c7-456a-a1c4-9bc75b6d6a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637fefdd-af38-4380-a8f3-dfc89279c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (637fefdd-af38-4380-a8f3-dfc89279c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374685124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea574a0-0727-42cc-8ee7-477f780c3c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097b077fc5c4a47b61c68515f121f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:57Z,use_quota=True,user_id='7816ae9f8f284abc870cc1129439c1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89bb110-6460-43fa-af78-a3fbae7900cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89bb110-6460-43fa-af78-a3fbae7900cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a45578-3e81-4b55-8fe7-f5f71aa4d73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a45578-3e81-4b55-8fe7-f5f71aa4d73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea574a0-0727-42cc-8ee7-477f780c3c3e', 'volume_name': 'volume-dea574a0-0727-42cc-8ee7-477f780c3c3e', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2862b0-e5d8-4592-8112-595d32707855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2862b0-e5d8-4592-8112-595d32707855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee3acdd-946e-4c80-a777-ac19f22d16f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:56 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Volume dea574a0-0727-42cc-8ee7-477f780c3c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea574a0-0727-42cc-8ee7-477f780c3c3e', 'volume_size': 1} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374685124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea574a0-0727-42cc-8ee7-477f780c3c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7097b077fc5c4a47b61c68515f121f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:41:57Z,use_quota=True,user_id='7816ae9f8f284abc870cc1129439c1b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Creating volume dea574a0-0727-42cc-8ee7-477f780c3c3e {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:41:56 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:56 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e 1073741824 Nov 01 12:41:56 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-b007dce3-88c5-4dfe-a4cd-055b7cff108f-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-b007dce3-88c5-4dfe-a4cd-055b7cff108f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-b007dce3-88c5-4dfe-a4cd-055b7cff108f" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-b007dce3-88c5-4dfe-a4cd-055b7cff108f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Deleting offline snapshot b007dce3-88c5-4dfe-a4cd-055b7cff108f of volume e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] snapshot_file for this snap is: volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[a730aa8f-cec5-461a-90d4-2639c9991f2d]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:56 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:57 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f Nov 01 12:41:57 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:57 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e 1073741824" returned: 0 in 0.449s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:57 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e Nov 01 12:41:57 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:57 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f" returned: 0 in 0.412s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ebced0-168d-478d-85fe-b275b677a7c4]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:57 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 Nov 01 12:41:57 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:57 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e" returned: 0 in 0.263s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee3acdd-946e-4c80-a777-ac19f22d16f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea574a0-0727-42cc-8ee7-477f780c3c3e', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d6f078-ed13-4627-b71c-6845fca20515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:41:57 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Volume volume-dea574a0-0727-42cc-8ee7-477f780c3c3e (dea574a0-0727-42cc-8ee7-477f780c3c3e): created successfully Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d6f078-ed13-4627-b71c-6845fca20515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Flow 'volume_create_manager' (3d738180-57c7-456a-a1c4-9bc75b6d6a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:41:57 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ab53de59-7bd1-4766-b704-a4c1e491e795 tempest-ProjectReaderTests-1851713611 None] Created volume successfully. Nov 01 12:41:57 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" returned: 0 in 0.397s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:57 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f Nov 01 12:41:57 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Creating offline snapshot 5cbd755e-1ae7-4fff-add2-a85c89e46f53 of volume dea574a0-0727-42cc-8ee7-477f780c3c3e {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb16ef1b-e4d5-43fa-aede-e2db48b22520]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:57 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:58 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e Nov 01 12:41:58 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:58 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f" returned: 0 in 0.351s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:58 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f Nov 01 12:41:58 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:58 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e" returned: 0 in 0.382s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:58 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 1G Nov 01 12:41:58 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:58 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7.b007dce3-88c5-4dfe-a4cd-055b7cff108f" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-b007dce3-88c5-4dfe-a4cd-055b7cff108f" released by "_delete_snapshot" :: held 1.529s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" released by "delete_snapshot" :: held 1.552s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Created reservations ['96ee862b-e025-4d5f-98ec-2f7887dc2cdc', '20b8e931-3ac2-4e62-b3b2-fca1b0874b1a', '946f2d60-f10a-478d-a8f9-01116213714c', 'c92437c1-9c60-4465-bdbd-afe3cb35b1ca'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:58 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Delete snapshot completed successfully. Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f7a7e885-1033-4c19-8b97-412eb5e41471 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-b007dce3-88c5-4dfe-a4cd-055b7cff108f-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:58 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 1G" returned: 0 in 0.406s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:58 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea574a0-0727-42cc-8ee7-477f780c3c3e -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:58 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea574a0-0727-42cc-8ee7-477f780c3c3e -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 Nov 01 12:41:58 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:59 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea574a0-0727-42cc-8ee7-477f780c3c3e -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53" returned: 0 in 0.299s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:59 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 is being set with open permissions: ugo+rw Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:59 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 Nov 01 12:41:59 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" acquired by "delete_volume" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf39be-7df7-4c90-bb5e-ed83929bc44d]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:59 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 Nov 01 12:41:59 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:59 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53" returned: 0 in 0.286s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:59 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.info Nov 01 12:41:59 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:59 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" returned: 0 in 0.389s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:59 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7 Nov 01 12:41:59 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:59 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.info" returned: 0 in 0.267s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:59 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.info is being set with open permissions: ugo+rw Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:41:59 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.info Nov 01 12:41:59 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:41:59 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7" released by "delete_volume" :: held 0.714s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:59 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.info" returned: 0 in 0.243s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:59 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-18122e40-b10c-484f-80b9-6740b6d04df9 tempest-ProjectReaderTests-1851713611 None] Create snapshot completed successfully Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Created reservations ['c329dca9-33ec-48c2-9cd7-e3f94667816d', 'e87d9aad-64c4-4cba-8e61-1fdfc3cc7db1', '2227c82a-417d-4357-b1d5-47021f04bcc6', 'd1180a37-5158-4bce-a257-809cd8ee3365'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:41:59 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-5cbd755e-1ae7-4fff-add2-a85c89e46f53-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:00 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:00 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-5cbd755e-1ae7-4fff-add2-a85c89e46f53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-dea574a0-0727-42cc-8ee7-477f780c3c3e" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-dea574a0-0727-42cc-8ee7-477f780c3c3e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-5cbd755e-1ae7-4fff-add2-a85c89e46f53" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-5cbd755e-1ae7-4fff-add2-a85c89e46f53" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Deleting offline snapshot 5cbd755e-1ae7-4fff-add2-a85c89e46f53 of volume dea574a0-0727-42cc-8ee7-477f780c3c3e {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] snapshot_file for this snap is: volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b6046a-3b81-4123-a336-3b47def69722]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:00 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 Nov 01 12:42:00 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:00 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.288s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:00 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Deleted volume successfully. Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-39d346be-66db-4781-93ff-bfd4cd2484b8 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-e6c9a463-6d92-481b-bcaa-5f2d3e254cf7-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:00 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53" returned: 0 in 0.433s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dea574a0-0727-42cc-8ee7-477f780c3c3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[126bd860-8b4d-40da-bce8-6dc7f8ca9ca4]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (d42f2979-aa40-4c3d-bf68-8231f26b5c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb16ba1-f6f2-4f3f-a76f-56c58cb18e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb16ba1-f6f2-4f3f-a76f-56c58cb18e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409266923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46befdb-003c-4086-be8f-e2a5b6d504d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:01Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e5d954-b549-4d2c-8850-b9f083b97021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e5d954-b549-4d2c-8850-b9f083b97021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:00 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dd5a78-f506-4b59-9152-3fbdcac580fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:00 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59dd5a78-f506-4b59-9152-3fbdcac580fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd46befdb-003c-4086-be8f-e2a5b6d504d9', 'volume_name': 'volume-d46befdb-003c-4086-be8f-e2a5b6d504d9', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffdfae73-f1bb-499e-ac97-f703ee2d1ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffdfae73-f1bb-499e-ac97-f703ee2d1ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15001112-ca15-4cfa-893c-41a91ae98c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:00 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Volume d46befdb-003c-4086-be8f-e2a5b6d504d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d46befdb-003c-4086-be8f-e2a5b6d504d9', 'volume_size': 1} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409266923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d46befdb-003c-4086-be8f-e2a5b6d504d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:01Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Creating volume d46befdb-003c-4086-be8f-e2a5b6d504d9 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:42:00 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:00 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 1073741824 Nov 01 12:42:00 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:00 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e" returned: 0 in 0.383s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:00 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:01 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 Nov 01 12:42:01 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:01 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 1073741824" returned: 0 in 0.450s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:01 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 Nov 01 12:42:01 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:01 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53" returned: 0 in 0.368s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:01 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53 Nov 01 12:42:01 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:01 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15001112-ca15-4cfa-893c-41a91ae98c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d46befdb-003c-4086-be8f-e2a5b6d504d9', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15deb824-402d-4598-a99f-291e3020444d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:01 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Volume volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 (d46befdb-003c-4086-be8f-e2a5b6d504d9): created successfully Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15deb824-402d-4598-a99f-291e3020444d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (d42f2979-aa40-4c3d-bf68-8231f26b5c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:01 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-97e35903-872a-443e-9c86-bc685482fcad tempest-ProjectMemberTests-1337080014 None] Created volume successfully. Nov 01 12:42:01 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e.5cbd755e-1ae7-4fff-add2-a85c89e46f53" returned: 0 in 0.276s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-5cbd755e-1ae7-4fff-add2-a85c89e46f53" released by "_delete_snapshot" :: held 1.608s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-dea574a0-0727-42cc-8ee7-477f780c3c3e" released by "delete_snapshot" :: held 1.631s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Created reservations ['86a18455-46af-4df9-b697-7ad922115309', 'dfde0221-9fe3-4316-a45a-0727891e7163', '88e4f62a-8d1a-4754-9951-e943f047d99b', '59aadbd9-b660-44c0-aefc-55a0f9dc84b4'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:01 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Delete snapshot completed successfully. Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-372287b7-49bb-4301-96cf-735dd2f80f27 tempest-ProjectReaderTests-1851713611 None] Lock "cinder-5cbd755e-1ae7-4fff-add2-a85c89e46f53-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Creating offline snapshot 95544745-8488-46b3-8e26-f77261ac8d83 of volume d46befdb-003c-4086-be8f-e2a5b6d504d9 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d088cfa-267c-4651-b385-2f7bfd5fce36]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:01 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:01 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 Nov 01 12:42:01 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-dea574a0-0727-42cc-8ee7-477f780c3c3e-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Lock "cinder-dea574a0-0727-42cc-8ee7-477f780c3c3e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Acquiring lock "cinder-quobyte-dea574a0-0727-42cc-8ee7-477f780c3c3e" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-dea574a0-0727-42cc-8ee7-477f780c3c3e" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:02 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9" returned: 0 in 0.426s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f1b317-a216-486b-92e2-d09d8b2f849b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:02 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 1G Nov 01 12:42:02 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:02 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e Nov 01 12:42:02 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:02 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e" returned: 0 in 0.392s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:02 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 1G" returned: 0 in 0.418s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:02 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e Nov 01 12:42:02 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:02 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 Nov 01 12:42:02 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:02 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:02 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-dea574a0-0727-42cc-8ee7-477f780c3c3e" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Lock "cinder-quobyte-dea574a0-0727-42cc-8ee7-477f780c3c3e" released by "delete_volume" :: held 0.732s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:03 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83" returned: 0 in 0.317s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:03 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 is being set with open permissions: ugo+rw Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Created reservations ['02b44a6f-6dd7-4e01-8283-3ffaec1ee3af', '6d0d6bfe-27b9-475d-b170-564b950ace3a', 'e9211580-cbc7-4cd6-874c-5c08cec49cf7', '1c045ae1-bc77-47ee-8833-765b4ead1d84'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:03 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 Nov 01 12:42:03 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:03 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:03 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:03 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83" returned: 0 in 0.271s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:03 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.info Nov 01 12:42:03 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:03 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.285s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:03 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Deleted volume successfully. Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-320a3a88-46d6-4dd2-b3e6-501b6de7240f tempest-ProjectReaderTests-1851713611 None] Lock "cinder-dea574a0-0727-42cc-8ee7-477f780c3c3e-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:03 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.info" returned: 0 in 0.279s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:03 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.info is being set with open permissions: ugo+rw Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:03 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.info Nov 01 12:42:03 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:03 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.info" returned: 0 in 0.295s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:03 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:03 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-fc1a8963-7e78-444a-a302-b54339376244 tempest-ProjectMemberTests-1337080014 None] Create snapshot completed successfully Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-95544745-8488-46b3-8e26-f77261ac8d83-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-95544745-8488-46b3-8e26-f77261ac8d83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-d46befdb-003c-4086-be8f-e2a5b6d504d9" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-d46befdb-003c-4086-be8f-e2a5b6d504d9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-95544745-8488-46b3-8e26-f77261ac8d83" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-95544745-8488-46b3-8e26-f77261ac8d83" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Deleting offline snapshot 95544745-8488-46b3-8e26-f77261ac8d83 of volume d46befdb-003c-4086-be8f-e2a5b6d504d9 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] snapshot_file for this snap is: volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c57186-1e9b-4657-99ee-aedf3ab83a8b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:05 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 Nov 01 12:42:05 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:05 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83" returned: 0 in 0.365s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d46befdb-003c-4086-be8f-e2a5b6d504d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[22076672-add6-4cf5-ac78-a9fcead0fbab]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:05 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 Nov 01 12:42:05 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:05 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9" returned: 0 in 0.356s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:05 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:05 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 Nov 01 12:42:05 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:06 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83" returned: 0 in 0.343s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:06 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83 Nov 01 12:42:06 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:06 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:06 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9.95544745-8488-46b3-8e26-f77261ac8d83" returned: 0 in 0.250s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-95544745-8488-46b3-8e26-f77261ac8d83" released by "_delete_snapshot" :: held 1.411s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-d46befdb-003c-4086-be8f-e2a5b6d504d9" released by "delete_snapshot" :: held 1.436s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:06 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:UPDATE=237,cinder:SELECT=190,cinder:INSERT=66,cinder:DELETE=19 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:42:06 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Created reservations ['a2bf7505-b12e-42d8-988e-4f61086ee910', 'dbcb1a6d-f810-44cb-8583-e8d84b82864f', 'fb80f8f0-45b3-479c-8d2b-ee9eac0fcac3', '6dfb48fa-1035-4642-a8c9-54a9a7c6e56d'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:06 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Delete snapshot completed successfully. Nov 01 12:42:06 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4360a6d8-881a-4577-a6c8-01f045981071 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-95544745-8488-46b3-8e26-f77261ac8d83-delete_snapshot" released by "delete_snapshot" :: held 1.588s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-d46befdb-003c-4086-be8f-e2a5b6d504d9-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-d46befdb-003c-4086-be8f-e2a5b6d504d9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=204,cinder:INSERT=69,cinder:UPDATE=252,cinder:DELETE=21 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-d46befdb-003c-4086-be8f-e2a5b6d504d9" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-d46befdb-003c-4086-be8f-e2a5b6d504d9" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[18eee732-f39e-4b60-b8a1-21657e6024cd]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:07 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 Nov 01 12:42:07 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:07 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9" returned: 0 in 0.362s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:07 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9 Nov 01 12:42:07 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:07 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d46befdb-003c-4086-be8f-e2a5b6d504d9" returned: 0 in 0.239s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-d46befdb-003c-4086-be8f-e2a5b6d504d9" released by "delete_volume" :: held 0.656s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:07 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Created reservations ['d74bd4cf-d1d6-4763-b41b-eee373b87853', '577ba3ca-7a8b-4647-b5d6-ec14b38a1f2a', '5af6de18-b730-43e6-b198-a2b6df419fe8', '06e004b1-3802-4e6a-b538-9bc347045331'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:08 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:08 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:08 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.270s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:08 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Deleted volume successfully. Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4cd88f1e-6b20-4963-a6a2-b52552a19343 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-d46befdb-003c-4086-be8f-e2a5b6d504d9-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (2c909889-ed5d-4e44-bf48-1557be4fa772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8746b5b3-0bb7-4b2d-a440-8f4748f68f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8746b5b3-0bb7-4b2d-a440-8f4748f68f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429592299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b634f7c6-a88f-42ed-9838-0d1376991ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:09Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987751d8-5e31-4dfa-9192-acaf03258f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987751d8-5e31-4dfa-9192-acaf03258f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dce7cd8-73cc-43c4-91b7-f7774330e34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dce7cd8-73cc-43c4-91b7-f7774330e34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b634f7c6-a88f-42ed-9838-0d1376991ec6', 'volume_name': 'volume-b634f7c6-a88f-42ed-9838-0d1376991ec6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34342d1d-c094-4659-a799-befaab39ed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34342d1d-c094-4659-a799-befaab39ed81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1406ba61-faaa-4881-a464-013ddf03dd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:08 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Volume b634f7c6-a88f-42ed-9838-0d1376991ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b634f7c6-a88f-42ed-9838-0d1376991ec6', 'volume_size': 1} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429592299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b634f7c6-a88f-42ed-9838-0d1376991ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:09Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Creating volume b634f7c6-a88f-42ed-9838-0d1376991ec6 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:42:08 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:42:08 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:08 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 1073741824 Nov 01 12:42:08 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:09 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 1073741824" returned: 0 in 0.440s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:09 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 Nov 01 12:42:09 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:09 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6" returned: 0 in 0.254s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:09 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:42:09 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1406ba61-faaa-4881-a464-013ddf03dd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b634f7c6-a88f-42ed-9838-0d1376991ec6', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702c5bf8-bd15-4639-aa50-b81da3899331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:09 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Volume volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 (b634f7c6-a88f-42ed-9838-0d1376991ec6): created successfully Nov 01 12:42:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (702c5bf8-bd15-4639-aa50-b81da3899331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:09 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (2c909889-ed5d-4e44-bf48-1557be4fa772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:09 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c3a63db5-38ee-45cc-abf4-6dd77f8a1063 tempest-ProjectMemberTests-1337080014 None] Created volume successfully. Nov 01 12:42:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:10 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Creating offline snapshot 06ba30ac-4a59-46b0-9236-d263b6144f59 of volume b634f7c6-a88f-42ed-9838-0d1376991ec6 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:42:10 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03ccd64-4502-40a7-b30b-5670c901fea9]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:10 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 Nov 01 12:42:10 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:10 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6" returned: 0 in 0.389s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:10 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 1G Nov 01 12:42:10 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:10 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 1G" returned: 0 in 0.413s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:10 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:10 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 Nov 01 12:42:10 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:11 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59" returned: 0 in 0.303s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:11 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 is being set with open permissions: ugo+rw Nov 01 12:42:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:11 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 Nov 01 12:42:11 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:11 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59" returned: 0 in 0.270s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:11 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.info Nov 01 12:42:11 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:11 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.info" returned: 0 in 0.257s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:11 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.info is being set with open permissions: ugo+rw Nov 01 12:42:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:11 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.info Nov 01 12:42:11 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:11 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:11 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.info" returned: 0 in 0.266s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:12 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:12 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-8ee4063c-311c-4a40-acbd-d5612ee67fa2 tempest-ProjectMemberTests-1337080014 None] Create snapshot completed successfully Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-06ba30ac-4a59-46b0-9236-d263b6144f59-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Lock "cinder-06ba30ac-4a59-46b0-9236-d263b6144f59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-b634f7c6-a88f-42ed-9838-0d1376991ec6" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-b634f7c6-a88f-42ed-9838-0d1376991ec6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-06ba30ac-4a59-46b0-9236-d263b6144f59" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-06ba30ac-4a59-46b0-9236-d263b6144f59" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Deleting offline snapshot 06ba30ac-4a59-46b0-9236-d263b6144f59 of volume b634f7c6-a88f-42ed-9838-0d1376991ec6 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] snapshot_file for this snap is: volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4f65c2-6e75-4029-bdcb-78d3f565e820]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:13 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 Nov 01 12:42:13 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:13 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59" returned: 0 in 0.368s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b634f7c6-a88f-42ed-9838-0d1376991ec6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[2111f909-93b0-4af5-83fc-a0c8f76b10ed]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:13 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:13 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 Nov 01 12:42:13 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Flow 'volume_create_manager' (747cf43a-5166-48b2-8932-ca98c01d5ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f477dec-c850-4394-97c9-16ba8f6de54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f477dec-c850-4394-97c9-16ba8f6de54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-553440278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a105d250-d55e-45f1-9424-59f0b839b8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145a290966f14537a0da3d21f94a7550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:14Z,use_quota=True,user_id='ffe1c88bc5944a85802ff93f3ef9f8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d824bd-092d-4cdf-bc0f-65e30f35483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:14 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d824bd-092d-4cdf-bc0f-65e30f35483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44feeed5-b427-4145-8582-ef6b36244a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44feeed5-b427-4145-8582-ef6b36244a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a105d250-d55e-45f1-9424-59f0b839b8e2', 'volume_name': 'volume-a105d250-d55e-45f1-9424-59f0b839b8e2', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d321b63-6aea-480a-9de8-455f12624368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d321b63-6aea-480a-9de8-455f12624368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169e155b-de84-4cff-b09c-9d49aca8cd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:14 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Volume a105d250-d55e-45f1-9424-59f0b839b8e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a105d250-d55e-45f1-9424-59f0b839b8e2', 'volume_size': 1} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-553440278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a105d250-d55e-45f1-9424-59f0b839b8e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145a290966f14537a0da3d21f94a7550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:14Z,use_quota=True,user_id='ffe1c88bc5944a85802ff93f3ef9f8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Creating volume a105d250-d55e-45f1-9424-59f0b839b8e2 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:42:14 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6" returned: 0 in 0.419s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:14 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2 1073741824 Nov 01 12:42:14 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:14 devstack sudo[108815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 Nov 01 12:42:14 devstack sudo[108815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:14 devstack sudo[108815]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59" returned: 0 in 0.356s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:14 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59 Nov 01 12:42:14 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:14 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2 1073741824" returned: 0 in 0.453s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:14 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2 Nov 01 12:42:14 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:14 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6.06ba30ac-4a59-46b0-9236-d263b6144f59" returned: 0 in 0.256s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-06ba30ac-4a59-46b0-9236-d263b6144f59" released by "_delete_snapshot" :: held 1.502s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-b634f7c6-a88f-42ed-9838-0d1376991ec6" released by "delete_snapshot" :: held 1.523s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Created reservations ['b6bdc5d8-7989-4467-82f1-0a798822dda9', '66879b39-04ca-4a4d-bfb3-9cfbd5f8ee93', 'c5e81c93-3933-4841-9745-0d05dddac6da', 'c7241be0-539a-4536-8155-75bea9497657'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:14 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2" returned: 0 in 0.263s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169e155b-de84-4cff-b09c-9d49aca8cd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a105d250-d55e-45f1-9424-59f0b839b8e2', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a7c412-eb4e-4e46-8eca-c3cbccc2136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:14 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Volume volume-a105d250-d55e-45f1-9424-59f0b839b8e2 (a105d250-d55e-45f1-9424-59f0b839b8e2): created successfully Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1a7c412-eb4e-4e46-8eca-c3cbccc2136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Flow 'volume_create_manager' (747cf43a-5166-48b2-8932-ca98c01d5ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:14 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Delete snapshot completed successfully. Nov 01 12:42:14 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-956d357a-8d91-4cdd-9f8b-e0b03a06804b tempest-ProjectMemberTests-1337080014 None] Lock "cinder-06ba30ac-4a59-46b0-9236-d263b6144f59-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:14 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-06fae07c-2b01-4bde-b79f-649817a6c215 tempest-ProjectReaderTests-1903626337 None] Created volume successfully. Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Acquiring lock "cinder-a105d250-d55e-45f1-9424-59f0b839b8e2-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Lock "cinder-a105d250-d55e-45f1-9424-59f0b839b8e2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Acquiring lock "cinder-quobyte-a105d250-d55e-45f1-9424-59f0b839b8e2" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Lock "cinder-quobyte-a105d250-d55e-45f1-9424-59f0b839b8e2" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac240134-720d-41f2-a4bb-ca5937568038]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:15 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2 Nov 01 12:42:15 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-b634f7c6-a88f-42ed-9838-0d1376991ec6-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-b634f7c6-a88f-42ed-9838-0d1376991ec6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-b634f7c6-a88f-42ed-9838-0d1376991ec6" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-b634f7c6-a88f-42ed-9838-0d1376991ec6" acquired by "delete_volume" :: waited 0.016s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4e49a5-54f9-47a9-92d5-3121aef7e94b]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:15 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 Nov 01 12:42:15 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:15 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2" returned: 0 in 0.402s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:15 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2 Nov 01 12:42:15 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:15 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6" returned: 0 in 0.361s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:15 devstack sudo[108844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6 Nov 01 12:42:15 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:15 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-a105d250-d55e-45f1-9424-59f0b839b8e2" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Lock "cinder-quobyte-a105d250-d55e-45f1-9424-59f0b839b8e2" released by "delete_volume" :: held 0.701s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:15 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Created reservations ['91c18c89-bd36-4dda-896f-a9b5b78cb68b', '459d9c33-4469-47cc-a8cd-34628b1db31b', 'd978b54b-3096-40bd-a59b-7549f8850ca4', '65e41f38-eadf-412c-b886-761a9c4e682f'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:16 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:16 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:16 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-b634f7c6-a88f-42ed-9838-0d1376991ec6" returned: 0 in 0.264s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-b634f7c6-a88f-42ed-9838-0d1376991ec6" released by "delete_volume" :: held 0.685s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Created reservations ['55ec173f-d6d6-4580-a0ab-44dd99fe616c', '72abe7ff-9a2e-49cf-85d8-a3a877c4df1c', '5502a1da-a739-408d-a437-c3a2e87c6102', 'e5cb9948-bd06-41c4-8d46-923f1420933b'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:16 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.273s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Deleted volume successfully. Nov 01 12:42:16 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:16 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-6386b105-1b7b-4d06-bc69-d56ede997fad tempest-ProjectReaderTests-1903626337 None] Lock "cinder-a105d250-d55e-45f1-9424-59f0b839b8e2-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:16 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.268s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:16 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Deleted volume successfully. Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-a6a07ee7-5d39-41ad-acaf-28f66aba5f16 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-b634f7c6-a88f-42ed-9838-0d1376991ec6-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Flow 'volume_create_manager' (dd43d1fa-c83a-424a-9035-4bb7620a59cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d26bcba-6c70-4022-965d-50acfc4e47a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d26bcba-6c70-4022-965d-50acfc4e47a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1002507626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637d79be-01cf-44ad-87f4-e9260338fd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145a290966f14537a0da3d21f94a7550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:17Z,use_quota=True,user_id='ffe1c88bc5944a85802ff93f3ef9f8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636f40af-26c9-4076-9d56-11ae97baecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636f40af-26c9-4076-9d56-11ae97baecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd520a1-2106-43cf-af71-0aca356a1589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd520a1-2106-43cf-af71-0aca356a1589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '637d79be-01cf-44ad-87f4-e9260338fd5b', 'volume_name': 'volume-637d79be-01cf-44ad-87f4-e9260338fd5b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947a8132-adc5-4b05-956b-0c2bcc0eb94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947a8132-adc5-4b05-956b-0c2bcc0eb94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242de7d6-c0da-40b4-85c3-a8dde1366454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:16 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Volume 637d79be-01cf-44ad-87f4-e9260338fd5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-637d79be-01cf-44ad-87f4-e9260338fd5b', 'volume_size': 1} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1002507626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637d79be-01cf-44ad-87f4-e9260338fd5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145a290966f14537a0da3d21f94a7550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:17Z,use_quota=True,user_id='ffe1c88bc5944a85802ff93f3ef9f8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Creating volume 637d79be-01cf-44ad-87f4-e9260338fd5b {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:42:16 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:16 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b 1073741824 Nov 01 12:42:16 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:16 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (5635b45a-f351-41a3-8ce7-72617f6098d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f12955-d016-4a51-8556-eabe64582143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f12955-d016-4a51-8556-eabe64582143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1089304768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49046b33-236e-46ea-936a-5ee2a425ce65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:17Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8791de-a945-4f7e-9563-fd0726b6b4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8791de-a945-4f7e-9563-fd0726b6b4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a91db77-3946-4a4e-b11a-76539e23d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a91db77-3946-4a4e-b11a-76539e23d261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49046b33-236e-46ea-936a-5ee2a425ce65', 'volume_name': 'volume-49046b33-236e-46ea-936a-5ee2a425ce65', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab637ce2-a8d3-4b93-84b2-feb6cf972f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab637ce2-a8d3-4b93-84b2-feb6cf972f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a751c0-c2df-4a02-b6fa-48ad8d8de511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:17 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Volume 49046b33-236e-46ea-936a-5ee2a425ce65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49046b33-236e-46ea-936a-5ee2a425ce65', 'volume_size': 1} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:17 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b 1073741824" returned: 0 in 0.412s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:17 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b Nov 01 12:42:17 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:17 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b" returned: 0 in 0.243s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1089304768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49046b33-236e-46ea-936a-5ee2a425ce65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:17Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Creating volume 49046b33-236e-46ea-936a-5ee2a425ce65 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:42:17 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242de7d6-c0da-40b4-85c3-a8dde1366454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-637d79be-01cf-44ad-87f4-e9260338fd5b', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:17 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 1073741824 Nov 01 12:42:17 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2ce9f0-7e60-47d4-a2db-51058cff8212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:17 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Volume volume-637d79be-01cf-44ad-87f4-e9260338fd5b (637d79be-01cf-44ad-87f4-e9260338fd5b): created successfully Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2ce9f0-7e60-47d4-a2db-51058cff8212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:17 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Flow 'volume_create_manager' (dd43d1fa-c83a-424a-9035-4bb7620a59cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:17 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6269233a-552f-4005-89ba-9df437ede548 tempest-ProjectReaderTests-1903626337 None] Created volume successfully. Nov 01 12:42:18 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 1073741824" returned: 0 in 0.420s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:18 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 Nov 01 12:42:18 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:18 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65" returned: 0 in 0.243s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a751c0-c2df-4a02-b6fa-48ad8d8de511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49046b33-236e-46ea-936a-5ee2a425ce65', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d8d2bc-e453-44fe-a4b6-d0327d086418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:18 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Volume volume-49046b33-236e-46ea-936a-5ee2a425ce65 (49046b33-236e-46ea-936a-5ee2a425ce65): created successfully Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d8d2bc-e453-44fe-a4b6-d0327d086418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (5635b45a-f351-41a3-8ce7-72617f6098d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:18 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-699c53b2-0fd3-411b-9470-0f306bcb8fad tempest-ProjectMemberTests-1337080014 None] Created volume successfully. Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "cinder-637d79be-01cf-44ad-87f4-e9260338fd5b-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-637d79be-01cf-44ad-87f4-e9260338fd5b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "cinder-quobyte-637d79be-01cf-44ad-87f4-e9260338fd5b" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:18 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-quobyte-637d79be-01cf-44ad-87f4-e9260338fd5b" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9af3e5-9a33-49d0-a6e5-c5f61e13925e]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:19 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b Nov 01 12:42:19 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Creating offline snapshot 2c961642-688d-48f3-a94b-55e1235c25d9 of volume 49046b33-236e-46ea-936a-5ee2a425ce65 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fa2d31-5d4d-48ec-a125-50fe7b4cb9c6]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:19 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b" returned: 0 in 0.379s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:19 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 Nov 01 12:42:19 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:19 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b Nov 01 12:42:19 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:19 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-637d79be-01cf-44ad-87f4-e9260338fd5b" returned: 0 in 0.259s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-quobyte-637d79be-01cf-44ad-87f4-e9260338fd5b" released by "delete_volume" :: held 0.689s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:19 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65" returned: 0 in 0.379s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:19 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 1G Nov 01 12:42:19 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Created reservations ['ef2cba94-6de6-4309-ab06-bd6ca666b975', '2a241bf3-bae8-46f5-bf78-0b2fd26c864f', 'b36f9673-0f82-4fb5-b0a0-7791dd63d8f9', '24451c16-f5cc-4e63-8cf7-b539849b04b1'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:19 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:19 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:19 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:20 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.267s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:20 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Deleted volume successfully. Nov 01 12:42:20 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 1G" returned: 0 in 0.423s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49046b33-236e-46ea-936a-5ee2a425ce65 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-1143540d-b9aa-46da-bad5-4c52a5b6eee4 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-637d79be-01cf-44ad-87f4-e9260338fd5b-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:20 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49046b33-236e-46ea-936a-5ee2a425ce65 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 Nov 01 12:42:20 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:20 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49046b33-236e-46ea-936a-5ee2a425ce65 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9" returned: 0 in 0.328s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:20 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 is being set with open permissions: ugo+rw Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:20 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 Nov 01 12:42:20 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Flow 'volume_create_manager' (1c2fc585-1d70-4be5-9e25-8bf5c4de8e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1565b2c-4774-4e40-8366-2ef16d93db26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1565b2c-4774-4e40-8366-2ef16d93db26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129489992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344625d2-f593-47cc-b92b-934a564dc7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145a290966f14537a0da3d21f94a7550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:21Z,use_quota=True,user_id='ffe1c88bc5944a85802ff93f3ef9f8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26499179-1b05-45fd-8045-065a4d8cae12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26499179-1b05-45fd-8045-065a4d8cae12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f6e116-b593-4eb7-8cec-19b54faba21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f6e116-b593-4eb7-8cec-19b54faba21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '344625d2-f593-47cc-b92b-934a564dc7cd', 'volume_name': 'volume-344625d2-f593-47cc-b92b-934a564dc7cd', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d420dd-15a4-4255-b4b0-51af0dc1881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d420dd-15a4-4255-b4b0-51af0dc1881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03850855-7b4c-47df-b018-ad7e6e6e9e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:20 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Volume 344625d2-f593-47cc-b92b-934a564dc7cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-344625d2-f593-47cc-b92b-934a564dc7cd', 'volume_size': 1} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:20 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9" returned: 0 in 0.254s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:20 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.info Nov 01 12:42:20 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:20 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.info" returned: 0 in 0.239s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:20 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.info is being set with open permissions: ugo+rw Nov 01 12:42:20 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:20 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.info Nov 01 12:42:20 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:21 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.info" returned: 0 in 0.248s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129489992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=344625d2-f593-47cc-b92b-934a564dc7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145a290966f14537a0da3d21f94a7550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:21Z,use_quota=True,user_id='ffe1c88bc5944a85802ff93f3ef9f8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Creating volume 344625d2-f593-47cc-b92b-934a564dc7cd {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:42:21 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:21 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd 1073741824 Nov 01 12:42:21 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:21 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-6368ee7b-6521-4b4b-ae69-04d5ac8f70a8 tempest-ProjectMemberTests-1337080014 None] Create snapshot completed successfully Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-2c961642-688d-48f3-a94b-55e1235c25d9-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-2c961642-688d-48f3-a94b-55e1235c25d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-49046b33-236e-46ea-936a-5ee2a425ce65" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-49046b33-236e-46ea-936a-5ee2a425ce65" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-2c961642-688d-48f3-a94b-55e1235c25d9" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-2c961642-688d-48f3-a94b-55e1235c25d9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Deleting offline snapshot 2c961642-688d-48f3-a94b-55e1235c25d9 of volume 49046b33-236e-46ea-936a-5ee2a425ce65 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] snapshot_file for this snap is: volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaf229d-4c5e-4eb6-ac80-9191fa6ba7e7]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:21 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 Nov 01 12:42:21 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:21 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd 1073741824" returned: 0 in 0.426s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:21 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd Nov 01 12:42:21 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:21 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9" returned: 0 in 0.396s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49046b33-236e-46ea-936a-5ee2a425ce65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d05bb1-cf61-4eea-bc86-b937475902bf]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:21 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd" returned: 0 in 0.252s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03850855-7b4c-47df-b018-ad7e6e6e9e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-344625d2-f593-47cc-b92b-934a564dc7cd', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a7016e-7f10-4dd2-b5ba-dfcc8e865469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:21 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Volume volume-344625d2-f593-47cc-b92b-934a564dc7cd (344625d2-f593-47cc-b92b-934a564dc7cd): created successfully Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19a7016e-7f10-4dd2-b5ba-dfcc8e865469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:21 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Flow 'volume_create_manager' (1c2fc585-1d70-4be5-9e25-8bf5c4de8e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:21 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e0118c7b-6eec-40d5-ab81-b12709a419c5 tempest-ProjectReaderTests-1903626337 None] Created volume successfully. Nov 01 12:42:22 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 Nov 01 12:42:22 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:22 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65" returned: 0 in 0.361s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:22 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 Nov 01 12:42:22 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:22 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9" returned: 0 in 0.348s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:22 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9 Nov 01 12:42:22 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "cinder-344625d2-f593-47cc-b92b-934a564dc7cd-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-344625d2-f593-47cc-b92b-934a564dc7cd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "cinder-quobyte-344625d2-f593-47cc-b92b-934a564dc7cd" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-quobyte-344625d2-f593-47cc-b92b-934a564dc7cd" acquired by "delete_volume" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[146895ac-f76f-4114-86d3-fbd34eef49ab]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:22 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65.2c961642-688d-48f3-a94b-55e1235c25d9" returned: 0 in 0.268s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:22 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd Nov 01 12:42:22 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-2c961642-688d-48f3-a94b-55e1235c25d9" released by "_delete_snapshot" :: held 1.482s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-49046b33-236e-46ea-936a-5ee2a425ce65" released by "delete_snapshot" :: held 1.506s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:22 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Created reservations ['082b7709-2157-45d7-9820-06e397e4df15', '83045c0e-6c67-4915-af7e-064cd53227d7', '700b181b-7cfa-438a-b024-0db7bf520672', '5936dd9c-23b8-494e-9998-71b299b40d50'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Delete snapshot completed successfully. Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-458e2526-a038-4296-ad7b-85d94d1535b0 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-2c961642-688d-48f3-a94b-55e1235c25d9-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:23 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd" returned: 0 in 0.359s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:23 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd Nov 01 12:42:23 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:23 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-344625d2-f593-47cc-b92b-934a564dc7cd" returned: 0 in 0.241s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-quobyte-344625d2-f593-47cc-b92b-934a564dc7cd" released by "delete_volume" :: held 0.642s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Created reservations ['915a4937-8911-47d4-b882-fa6d80db6ce0', '658c7e54-0c59-415f-9838-7b313dbee5eb', 'c4de2c57-3ebe-43a1-8ff9-fcfbbfd5776c', 'a951795b-5945-4285-9dbe-2fe982a4ed03'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-49046b33-236e-46ea-936a-5ee2a425ce65-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:23 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:23 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Lock "cinder-49046b33-236e-46ea-936a-5ee2a425ce65-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-49046b33-236e-46ea-936a-5ee2a425ce65" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-49046b33-236e-46ea-936a-5ee2a425ce65" acquired by "delete_volume" :: waited 0.013s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ac6c4d-ccee-4226-b3e9-2973b0639c0c]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:23 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 Nov 01 12:42:23 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:23 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.255s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:23 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Deleted volume successfully. Nov 01 12:42:23 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-af93b421-1502-4cc8-9c96-2b3e2892dfc6 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-344625d2-f593-47cc-b92b-934a564dc7cd-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:24 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65" returned: 0 in 0.387s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:24 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65 Nov 01 12:42:24 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:24 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-49046b33-236e-46ea-936a-5ee2a425ce65" returned: 0 in 0.280s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-49046b33-236e-46ea-936a-5ee2a425ce65" released by "delete_volume" :: held 0.727s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Flow 'volume_create_manager' (e0b24ade-6433-4d4b-b697-e25555bee3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb5692d-e4b2-4c8d-b5c4-1bdd8412b12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb5692d-e4b2-4c8d-b5c4-1bdd8412b12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412301004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145a290966f14537a0da3d21f94a7550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:24Z,use_quota=True,user_id='ffe1c88bc5944a85802ff93f3ef9f8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3b1535-4938-4595-a619-0012c53120fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3b1535-4938-4595-a619-0012c53120fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d8d85b-d07b-4f32-9cab-1e8248065c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d8d85b-d07b-4f32-9cab-1e8248065c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff', 'volume_name': 'volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d095a8e4-ef1a-4fe7-855a-6f5bf9769c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d095a8e4-ef1a-4fe7-855a-6f5bf9769c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e1b085-3d1c-4f77-9cba-2375be480cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:24 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Volume 294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff', 'volume_size': 1} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412301004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='145a290966f14537a0da3d21f94a7550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:24Z,use_quota=True,user_id='ffe1c88bc5944a85802ff93f3ef9f8de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Creating volume 294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:42:24 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:24 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff 1073741824 Nov 01 12:42:24 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Created reservations ['62f7f64f-dc84-4e56-b07c-7c716d396326', '3b933217-9443-4b22-85de-b1f5405f3e79', '7b8a2316-c98d-4536-a533-00885eef2e94', '23a54136-e836-4f69-8867-95ab5f9f7cb7'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:24 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:24 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:24 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.275s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:24 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Deleted volume successfully. Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ebe52803-43d7-4915-b821-44c390aa243a tempest-ProjectMemberTests-1337080014 None] Lock "cinder-49046b33-236e-46ea-936a-5ee2a425ce65-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:24 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff 1073741824" returned: 0 in 0.485s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:24 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:25 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff Nov 01 12:42:25 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (90a93cf0-c999-4ee0-837e-168173067f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ecead7-212d-4716-ab1c-2054e590eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:25 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff" returned: 0 in 0.274s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ecead7-212d-4716-ab1c-2054e590eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389901647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4312d9d0-cb9c-4591-95dd-244ad636e5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:25Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc924a7-4ad2-44f2-aac7-17dea76477ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc924a7-4ad2-44f2-aac7-17dea76477ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c2aedb-154a-409d-9afe-4a089614dfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c2aedb-154a-409d-9afe-4a089614dfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4312d9d0-cb9c-4591-95dd-244ad636e5b4', 'volume_name': 'volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490cec02-1c03-4995-aca6-295274e49a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490cec02-1c03-4995-aca6-295274e49a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981249cf-2e5f-4055-9a38-b99f2dd7ef9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Volume 4312d9d0-cb9c-4591-95dd-244ad636e5b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4', 'volume_size': 1} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389901647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4312d9d0-cb9c-4591-95dd-244ad636e5b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:25Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Creating volume 4312d9d0-cb9c-4591-95dd-244ad636e5b4 {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:42:25 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e1b085-3d1c-4f77-9cba-2375be480cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2ab7ba-4298-40e8-9634-0e0ac091b42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:25 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 1073741824 Nov 01 12:42:25 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:25 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Volume volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff (294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff): created successfully Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2ab7ba-4298-40e8-9634-0e0ac091b42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Flow 'volume_create_manager' (e0b24ade-6433-4d4b-b697-e25555bee3f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:25 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-75075a01-1aaf-4fb2-8b7d-773feee93b03 tempest-ProjectReaderTests-1903626337 None] Created volume successfully. Nov 01 12:42:25 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 1073741824" returned: 0 in 0.403s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:25 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 Nov 01 12:42:25 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:25 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4" returned: 0 in 0.243s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:25 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981249cf-2e5f-4055-9a38-b99f2dd7ef9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3efe274-4059-418d-b0fe-d8daded8a21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:26 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Volume volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 (4312d9d0-cb9c-4591-95dd-244ad636e5b4): created successfully Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3efe274-4059-418d-b0fe-d8daded8a21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (90a93cf0-c999-4ee0-837e-168173067f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:26 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9da4f1f2-cd14-4c73-bce7-b249178ba972 tempest-ProjectMemberTests-1337080014 None] Created volume successfully. Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Creating offline snapshot b4b5e086-dea5-428a-99f1-e926fe9c7fd2 of volume 4312d9d0-cb9c-4591-95dd-244ad636e5b4 {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[46920984-e173-4af4-bb7e-8e5d438ed823]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "cinder-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:26 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 Nov 01 12:42:26 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "cinder-quobyte-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-quobyte-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff" acquired by "delete_volume" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0abef7d-0c9d-4d52-8df2-41473006d801]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:26 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff Nov 01 12:42:26 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:26 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4" returned: 0 in 0.376s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:26 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 1G Nov 01 12:42:26 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:26 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff" returned: 0 in 0.382s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:26 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:26 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff Nov 01 12:42:26 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:27 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 1G" returned: 0 in 0.401s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:27 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 Nov 01 12:42:27 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:27 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff" returned: 0 in 0.290s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-quobyte-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff" released by "delete_volume" :: held 0.726s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Created reservations ['2982c472-0619-4a79-8701-a9a16ff04cbb', 'e168fa6e-0004-453b-b945-4f6e5f33ce8c', 'af46de12-0a5b-4103-b873-ade2563eace0', '8411ed50-321a-4927-876d-72f6c451963c'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:27 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:27 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:27 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2" returned: 0 in 0.300s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:27 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 is being set with open permissions: ugo+rw Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:27 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 Nov 01 12:42:27 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:27 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.261s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:27 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Deleted volume successfully. Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-f88584ea-b0bd-4a87-873f-cce8ecb9b046 tempest-ProjectReaderTests-1903626337 None] Lock "cinder-294ea39e-8e2a-4bc0-ba23-ac4b20b5a3ff-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:27 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2" returned: 0 in 0.247s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:27 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:27 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.info Nov 01 12:42:27 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:28 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.info" returned: 0 in 0.284s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:28 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.info is being set with open permissions: ugo+rw Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:28 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.info Nov 01 12:42:28 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:28 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.info" returned: 0 in 0.247s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:28 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-c96361e9-33a5-4c00-976f-bfd42f906660 tempest-ProjectMemberTests-1337080014 None] Create snapshot completed successfully Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-b4b5e086-dea5-428a-99f1-e926fe9c7fd2-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Lock "cinder-b4b5e086-dea5-428a-99f1-e926fe9c7fd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-4312d9d0-cb9c-4591-95dd-244ad636e5b4" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-4312d9d0-cb9c-4591-95dd-244ad636e5b4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-b4b5e086-dea5-428a-99f1-e926fe9c7fd2" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-b4b5e086-dea5-428a-99f1-e926fe9c7fd2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Deleting offline snapshot b4b5e086-dea5-428a-99f1-e926fe9c7fd2 of volume 4312d9d0-cb9c-4591-95dd-244ad636e5b4 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] snapshot_file for this snap is: volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba459f93-16e6-4a1a-9d78-daf2284c32d1]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:28 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 Nov 01 12:42:28 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:28 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2" returned: 0 in 0.377s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:28 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:42:29 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4765a21-56ee-4953-a6c4-5a351378ab7a]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:29 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 Nov 01 12:42:29 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:29 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4" returned: 0 in 0.378s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:29 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 Nov 01 12:42:29 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:29 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2" returned: 0 in 0.328s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:29 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2 Nov 01 12:42:29 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:29 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:29 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4.b4b5e086-dea5-428a-99f1-e926fe9c7fd2" returned: 0 in 0.244s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-b4b5e086-dea5-428a-99f1-e926fe9c7fd2" released by "_delete_snapshot" :: held 1.434s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-4312d9d0-cb9c-4591-95dd-244ad636e5b4" released by "delete_snapshot" :: held 1.462s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:30 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Created reservations ['8b5b1c4f-993a-4cac-b750-3416fe4b8ae2', '04c28948-3c86-4314-bf22-2c936a08bfda', 'd038caa3-b0bc-4d6a-9de9-2015ed326a07', 'f1ae4246-cab1-4aca-bfab-16d883d9ea43'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:30 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Delete snapshot completed successfully. Nov 01 12:42:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-4220302e-52ce-4319-a61a-b178dedde9fb tempest-ProjectMemberTests-1337080014 None] Lock "cinder-b4b5e086-dea5-428a-99f1-e926fe9c7fd2-delete_snapshot" released by "delete_snapshot" :: held 1.597s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-4312d9d0-cb9c-4591-95dd-244ad636e5b4-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Lock "cinder-4312d9d0-cb9c-4591-95dd-244ad636e5b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-4312d9d0-cb9c-4591-95dd-244ad636e5b4" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:30 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-4312d9d0-cb9c-4591-95dd-244ad636e5b4" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:30 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d96eeb0-0797-4807-9eb6-1bbaac8ef5f4]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:30 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:30 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 Nov 01 12:42:30 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:31 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4" returned: 0 in 0.363s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:31 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4 Nov 01 12:42:31 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:31 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-4312d9d0-cb9c-4591-95dd-244ad636e5b4" returned: 0 in 0.245s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-4312d9d0-cb9c-4591-95dd-244ad636e5b4" released by "delete_volume" :: held 0.665s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Created reservations ['84c9b34f-edba-4cec-8746-aea50ddc5fdd', '384ad8b0-64ab-4300-b675-d9da50a0416d', '84e4e64b-bcc0-4b34-947c-895287b5201a', '1551b6c3-1f48-4ec9-86c1-cf8db973b178'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:31 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:31 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:31 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.239s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:31 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Deleted volume successfully. Nov 01 12:42:31 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-ce3a0f19-b9bf-4164-a99d-4dcb4855efff tempest-ProjectMemberTests-1337080014 None] Lock "cinder-4312d9d0-cb9c-4591-95dd-244ad636e5b4-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.flows.manager.create_volume [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86812) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (978c6798-181c-41e7-b59f-18f427b44011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b010e2cd-0a94-44a3-8f1f-b5f17c4d1ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b010e2cd-0a94-44a3-8f1f-b5f17c4d1ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994754491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73a793c-fc59-4065-9904-f1b40f620f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:32Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d1ca2c-75f5-44e6-b79f-696cb37c0bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d1ca2c-75f5-44e6-b79f-696cb37c0bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b8c2fb-08f4-4111-bba4-b1c3781ee3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b8c2fb-08f4-4111-bba4-b1c3781ee3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73a793c-fc59-4065-9904-f1b40f620f7a', 'volume_name': 'volume-d73a793c-fc59-4065-9904-f1b40f620f7a', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea6c3d8-d6c4-4cce-9456-67490893f242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea6c3d8-d6c4-4cce-9456-67490893f242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61646a5-988d-409a-ad67-2d37ab558cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:32 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Volume d73a793c-fc59-4065-9904-f1b40f620f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73a793c-fc59-4065-9904-f1b40f620f7a', 'volume_size': 1} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994754491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73a793c-fc59-4065-9904-f1b40f620f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d41dc74312984007a2a2dbceeb9297bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:42:32Z,use_quota=True,user_id='41b491e18fe04634be723a042f2493df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83797a37-5a26-44a2-96c1-e9f1d7108c68),volume_type_id=83797a37-5a26-44a2-96c1-e9f1d7108c68)}" {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Creating volume d73a793c-fc59-4065-9904-f1b40f620f7a {{(pid=86812) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Selected osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 as target Quobyte volume. {{(pid=86812) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:42:32 devstack cinder-volume[86812]: INFO cinder.volume.drivers.remotefs [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] casted to osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066 Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a 1073741824 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:32 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a 1073741824 Nov 01 12:42:32 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:32 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a 1073741824" returned: 0 in 0.396s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:32 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:32 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a Nov 01 12:42:32 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:33 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a" returned: 0 in 0.245s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'} {{(pid=86812) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61646a5-988d-409a-ad67-2d37ab558cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73a793c-fc59-4065-9904-f1b40f620f7a', 'volume_size': 1}' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db0d981-725d-4e5a-b3c7-a344bf5c1a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:42:33 devstack cinder-volume[86812]: INFO cinder.volume.flows.manager.create_volume [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Volume volume-d73a793c-fc59-4065-9904-f1b40f620f7a (d73a793c-fc59-4065-9904-f1b40f620f7a): created successfully Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7db0d981-725d-4e5a-b3c7-a344bf5c1a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86812) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Flow 'volume_create_manager' (978c6798-181c-41e7-b59f-18f427b44011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86812) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:42:33 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-abcea1f3-e680-46b3-95ca-010330165d13 tempest-ProjectMemberTests-1337080014 None] Created volume successfully. Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Creating offline snapshot b5295dee-4d52-4f0f-9e1c-88855b5469db of volume d73a793c-fc59-4065-9904-f1b40f620f7a {{(pid=86812) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[df76ca8c-9249-483b-a10f-ca50178ee7ca]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:33 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a Nov 01 12:42:33 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:33 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a" returned: 0 in 0.349s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:33 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db 1G {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:33 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db 1G Nov 01 12:42:33 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:34 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db 1G" returned: 0 in 0.384s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73a793c-fc59-4065-9904-f1b40f620f7a -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:34 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73a793c-fc59-4065-9904-f1b40f620f7a -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db Nov 01 12:42:34 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:34 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73a793c-fc59-4065-9904-f1b40f620f7a -F qcow2 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db" returned: 0 in 0.287s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:34 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db is being set with open permissions: ugo+rw Nov 01 12:42:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:34 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db Nov 01 12:42:34 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:34 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db" returned: 0 in 0.248s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:34 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.info Nov 01 12:42:34 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:34 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.info" returned: 0 in 0.244s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:34 devstack cinder-volume[86812]: WARNING cinder.volume.drivers.remotefs [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.info is being set with open permissions: ugo+rw Nov 01 12:42:34 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.info {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:35 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.info Nov 01 12:42:35 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:35 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.info" returned: 0 in 0.251s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:35 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-9bfc28f8-ced5-430a-adc3-e43c1065a17d tempest-ProjectMemberTests-1337080014 None] Create snapshot completed successfully Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-b5295dee-4d52-4f0f-9e1c-88855b5469db-delete_snapshot" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-b5295dee-4d52-4f0f-9e1c-88855b5469db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-d73a793c-fc59-4065-9904-f1b40f620f7a" by "delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-d73a793c-fc59-4065-9904-f1b40f620f7a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-b5295dee-4d52-4f0f-9e1c-88855b5469db" by "_delete_snapshot" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-b5295dee-4d52-4f0f-9e1c-88855b5469db" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Deleting offline snapshot b5295dee-4d52-4f0f-9e1c-88855b5469db of volume d73a793c-fc59-4065-9904-f1b40f620f7a {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] snapshot_file for this snap is: volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db {{(pid=86812) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a013ca5-3a51-420f-9cd1-6dd6fdb63889]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:35 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:35 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db Nov 01 12:42:35 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:36 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db" returned: 0 in 0.360s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.remotefs [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d73a793c-fc59-4065-9904-f1b40f620f7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86812) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[548507fd-a1b7-40f4-91e9-2be5c5e688d5]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:36 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a Nov 01 12:42:36 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:36 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a" returned: 0 in 0.352s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:36 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db Nov 01 12:42:36 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:36 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db" returned: 0 in 0.335s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:36 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db Nov 01 12:42:36 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:36 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:37 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:37 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:37 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a.b5295dee-4d52-4f0f-9e1c-88855b5469db" returned: 0 in 0.264s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-b5295dee-4d52-4f0f-9e1c-88855b5469db" released by "_delete_snapshot" :: held 1.401s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-d73a793c-fc59-4065-9904-f1b40f620f7a" released by "delete_snapshot" :: held 1.422s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Created reservations ['3a0aa74f-09a0-4dbb-89ad-c8149c987caf', '15eb6c67-0647-462e-8170-1f839f67ac2a', '713f99c8-befd-40f7-95df-b16566d93e55', 'ff36df7e-f973-4c96-8f11-2f0be9e7f855'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:37 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Delete snapshot completed successfully. Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-368f1629-6dda-44c4-8466-3aeb1b0687c5 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-b5295dee-4d52-4f0f-9e1c-88855b5469db-delete_snapshot" released by "delete_snapshot" :: held 1.569s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:37 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.249s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG oslo_service.periodic_task [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] Running periodic task VolumeManager._thread_info {{(pid=86812) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread count: 29 {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.volume.manager [None req-30519175-a9de-49d8-b002-d5a4b02e0905 None None] thread info: [<_MainThread(MainThread, started 126892061229184)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86812) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-d73a793c-fc59-4065-9904-f1b40f620f7a-delete_volume" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-d73a793c-fc59-4065-9904-f1b40f620f7a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "cinder-quobyte-d73a793c-fc59-4065-9904-f1b40f620f7a" by "delete_volume" {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-d73a793c-fc59-4065-9904-f1b40f620f7a" acquired by "delete_volume" :: waited 0.017s {{(pid=86812) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG oslo.privsep.daemon [-] privsep: reply[291b1b6a-9e29-44d5-ae5d-9b6dfb73f733]: (4, 'qcow2') {{(pid=88222) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:42:37 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:37 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a Nov 01 12:42:37 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:38 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a" returned: 0 in 0.352s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:38 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a Nov 01 12:42:38 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:38 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92/volume-d73a793c-fc59-4065-9904-f1b40f620f7a" returned: 0 in 0.236s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-quobyte-d73a793c-fc59-4065-9904-f1b40f620f7a" released by "delete_volume" :: held 0.651s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG cinder.quota [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Created reservations ['9d979b53-5353-41be-9c91-254d71ea1689', 'ccabdd78-a8f4-4904-9be5-4b56c8473b17', 'ec172624-4c57-4920-bfd1-97759d7b63c3', '0eefe0fc-92b5-460d-b7b5-b08078de1821'] {{(pid=86812) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066': None} {{(pid=86812) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG cinder.volume.drivers.quobyte [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2c520b57-176d-445c-8e14-8fe064684066'] {{(pid=86812) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.lockutils [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86812) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:42:38 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92 Nov 01 12:42:38 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:42:38 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG oslo_concurrency.processutils [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3bb8e3753c46fe7351ca02b7e8938c92" returned: 0 in 0.244s {{(pid=86812) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG cinder.manager [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Notifying Schedulers of capabilities ... {{(pid=86812) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:42:38 devstack cinder-volume[86812]: INFO cinder.volume.manager [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Deleted volume successfully. Nov 01 12:42:38 devstack cinder-volume[86812]: DEBUG cinder.coordination [None req-e4c187da-9f0a-4882-bbca-ed66842587c9 tempest-ProjectMemberTests-1337080014 None] Lock "cinder-d73a793c-fc59-4065-9904-f1b40f620f7a-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86812) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:42:55 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=83,cinder:INSERT=39,cinder:UPDATE=129,cinder:DELETE=11 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:42:55 devstack cinder-volume[86812]: DEBUG dbcounter [-] [86812] Writing DB stats cinder:SELECT=97,cinder:INSERT=27,cinder:UPDATE=127,cinder:DELETE=10 {{(pid=86812) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}